[ 521.233343] env[65323]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 521.233343] env[65323]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 522.250555] env[65413]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 522.250555] env[65413]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 523.854853] env[65413]: INFO neutron.common.config [-] Logging enabled! [ 523.855276] env[65413]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 27.0.1.dev33 [ 523.855406] env[65413]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=65413) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 523.855716] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 523.855812] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 523.856672] env[65413]: WARNING oslo_policy.policy [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 523.856898] env[65413]: WARNING oslo_policy.policy [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 523.858621] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] VMware NSXv3 Agent initialized successfully. [ 523.858968] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] Acquiring lock "singleton_lock" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 523.859108] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] Acquired lock "singleton_lock" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 523.859313] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] Releasing lock "singleton_lock" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 523.859624] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] Full set of CONF: {{(pid=65413) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 523.859737] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ******************************************************************************** {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 523.859835] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] Configuration options gathered from: {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 523.860183] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 523.860350] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 523.860452] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ================================================================================ {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 523.860613] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] agent_down_time = 75 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.860753] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] allow_automatic_dhcp_failover = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.860883] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] allow_bulk = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.861030] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] api_extensions_path = {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.861164] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] api_paste_config = api-paste.ini {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.861296] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] auth_strategy = keystone {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.861396] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] backdoor_port = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.861493] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] backdoor_socket = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.861626] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] backlog = 4096 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.861751] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] base_mac = fa:16:3e:00:00:00 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.861899] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] bind_host = 0.0.0.0 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.862078] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] bind_port = 9696 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.862217] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] client_socket_timeout = 900 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.862349] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] config_dir = [] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.862453] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.862584] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] config_source = [] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.862717] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] control_exchange = neutron {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.862849] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] core_plugin = ml2 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.862978] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] debug = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.863119] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] default_availability_zones = [] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.863322] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.863472] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] dhcp_agent_notification = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.863653] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] dhcp_agents_per_network = 1 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.863805] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] dhcp_lease_duration = 86400 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.863945] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] dhcp_load_type = networks {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.864089] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] dns_domain = openstacklocal {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.864224] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.864351] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] enable_default_route_bfd = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.864474] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] enable_default_route_ecmp = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.864599] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] enable_dvr = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.864721] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] enable_new_agents = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.864843] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] enable_services_on_agents_with_admin_state_down = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.864963] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] enable_signals = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.865104] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] enable_traditional_dhcp = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.865245] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] external_dns_driver = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.865399] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] filter_validation = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.865541] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] global_physnet_mtu = 8950 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.865668] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] graceful_shutdown_timeout = 60 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.865839] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] host = cpu-1 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.865974] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] host_dvr_for_dhcp = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.866115] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] http_retries = 3 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.866249] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] instance_format = [instance: %(uuid)s] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.866379] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.866508] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ipam_driver = internal {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.866648] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ipv6_pd_enabled = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.866791] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] l3_ha = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.866925] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.867067] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] l3_ha_network_physical_name = {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.867201] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] l3_ha_network_type = {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.867332] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] log_color = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.867468] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] log_config_append = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.867595] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.867721] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] log_dir = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.867844] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] log_file = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.867940] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] log_options = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.868083] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] log_rotate_interval = 1 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.868221] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] log_rotate_interval_type = days {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.868351] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] log_rotation_type = none {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.868464] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.868552] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.868680] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.868809] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.868906] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.869043] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] max_dns_nameservers = 5 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.869170] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] max_header_line = 16384 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.869294] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] max_l3_agents_per_router = 3 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.869449] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] max_logfile_count = 30 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.869583] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] max_logfile_size_mb = 200 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.869708] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] max_subnet_host_routes = 20 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.869839] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] my_ip = 10.180.1.21 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.869966] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] my_ipv6 = ::1 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.870102] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] network_auto_schedule = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.870223] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] network_link_prefix = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.870351] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.870483] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] notify_nova_on_port_data_changes = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.870609] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] notify_nova_on_port_status_changes = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.870743] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] pagination_max_limit = -1 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.870901] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] publish_errors = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.871040] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] rate_limit_burst = 0 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.871177] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] rate_limit_except_level = CRITICAL {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.871303] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] rate_limit_interval = 0 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.871426] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] retry_until_window = 30 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.871549] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] router_distributed = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.871673] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] rpc_resources_processing_step = 20 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.871795] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] rpc_response_max_timeout = 600 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.871921] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] rpc_response_timeout = 60 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.872051] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] send_events_interval = 2 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.872226] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] service_plugins = ['router'] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.872365] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] setproctitle = on {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.872489] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] shell_completion = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.872621] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] state_path = /opt/stack/data/neutron {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.872753] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] syslog_log_facility = LOG_USER {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.872879] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] tcp_keepidle = 600 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.873033] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] transport_url = **** {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.873142] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] use_journal = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.873266] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] use_json = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.873389] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] use_ssl = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.873509] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] use_stderr = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.873649] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] use_syslog = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.873772] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] vlan_qinq = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.873890] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] vlan_transparent = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.874020] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] watch_log_file = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.874147] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] wsgi_default_pool_size = 100 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.874271] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] wsgi_keep_alive = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.874400] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.874526] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] wsgi_server_debug = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 523.874672] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_concurrency.disable_process_locking = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.874810] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.874972] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.875126] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.875261] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.875392] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.875520] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.875666] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] profiler.connection_string = messaging:// {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.875798] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] profiler.enabled = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.875931] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] profiler.es_doc_type = notification {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.876285] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] profiler.es_scroll_size = 10000 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.876285] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] profiler.es_scroll_time = 2m {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.876431] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] profiler.filter_error_trace = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.876546] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] profiler.hmac_keys = **** {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.876694] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] profiler.sentinel_service_name = mymaster {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.876834] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] profiler.socket_timeout = 0.1 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.876962] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] profiler.trace_requests = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.877101] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] profiler.trace_sqlalchemy = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.877241] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] profiler_jaeger.process_tags = {} {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.877368] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] profiler_jaeger.service_name_prefix = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.877498] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] profiler_otlp.service_name_prefix = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.877650] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_policy.enforce_new_defaults = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.877953] env[65413]: WARNING oslo_config.cfg [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 523.878121] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_policy.enforce_scope = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.878264] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_policy.policy_default_rule = default {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.878409] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.878548] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.878686] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.878811] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.878935] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.879067] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.879201] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.879376] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_policy.remote_timeout = 60.0 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.879533] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.879679] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] agent.extensions = [] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.879814] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.879948] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] service_providers.service_provider = [] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.880096] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] QUOTAS.default_quota = -1 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.880233] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.880358] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] QUOTAS.quota_floatingip = 50 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.880487] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] QUOTAS.quota_network = 100 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.880632] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] QUOTAS.quota_port = 500 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.880780] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] QUOTAS.quota_rbac_policy = 10 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.880909] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] QUOTAS.quota_router = 10 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.881048] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] QUOTAS.quota_security_group = 10 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.881179] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] QUOTAS.quota_security_group_rule = 100 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.881306] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] QUOTAS.quota_subnet = 100 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.881433] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] QUOTAS.track_quota_usage = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.881573] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.881701] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep.group = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.881827] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep.helper_command = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.881952] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep.log_daemon_traceback = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.882104] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep.logger_name = oslo_privsep.daemon {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.882238] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep.thread_pool_size = 8 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.882364] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep.user = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.882501] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.882627] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_dhcp_release.group = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.882748] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_dhcp_release.helper_command = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.882871] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.882999] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.883139] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.883264] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_dhcp_release.user = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.883433] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.883567] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_ovs_vsctl.group = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.883693] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_ovs_vsctl.helper_command = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.883818] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.883946] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.884085] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.884212] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_ovs_vsctl.user = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.884345] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_namespace.capabilities = [21] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.884470] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_namespace.group = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.884595] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_namespace.helper_command = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.884734] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_namespace.log_daemon_traceback = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.884933] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.885096] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_namespace.thread_pool_size = 8 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.885229] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_namespace.user = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.885497] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_conntrack.capabilities = [12] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.885497] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_conntrack.group = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.885618] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_conntrack.helper_command = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.885736] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_conntrack.log_daemon_traceback = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.885868] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.885997] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_conntrack.thread_pool_size = 8 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.886134] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_conntrack.user = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.886275] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_link.capabilities = [12, 21] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.886435] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_link.group = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.886569] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_link.helper_command = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.886697] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_link.log_daemon_traceback = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.886827] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.886955] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_link.thread_pool_size = 8 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.887091] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] privsep_link.user = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.887242] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.887380] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.887514] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.continue_on_failed_promotions = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.887640] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.dscp = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.887773] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.dscp_inherit = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.887910] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.force_mp_to_policy = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.888047] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.locking_coordinator_url = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.888179] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.log_agent_heartbeats = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.888308] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.logging_expire = 1 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.888442] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.888575] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.888705] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.polling_interval = 240 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.888832] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.888978] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.quitting_rpc_timeout = 120 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.889157] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.report_interval = 30.0 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.889296] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.889431] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.889565] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.889697] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.sync_skew = 60 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.889825] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.synchronization_queue_size = 20 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.889951] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT.use_helper_for_ns_read = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.890097] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] SECURITYGROUP.enable_ipset = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.890235] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] SECURITYGROUP.enable_security_group = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.890391] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.890576] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.890724] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] experimental.ipv6_pd_enabled = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.890879] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ml2.extension_drivers = ['port_security'] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.891014] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ml2.external_network_type = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.891167] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.891303] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ml2.overlay_ip_version = 4 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.891436] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ml2.path_mtu = 8950 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.891574] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ml2.physical_network_mtus = {} {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.891714] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ml2.tenant_network_types = ['vlan'] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.891847] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.892035] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ml2.type_drivers = ['vlan'] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.892184] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT_CLI.neutron_port_id = [] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.892315] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.892444] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.892582] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.892717] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.892847] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.892978] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.893123] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.893260] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.893501] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.893649] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_login_password = **** {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.893787] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_login_port = 443 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.893920] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_login_user = admin {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.894065] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.894204] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.894332] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.894459] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.894592] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.894760] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.894906] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.895051] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.895183] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.895314] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.895452] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.895586] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.895708] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.895894] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.896060] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] vsphere.vsphere_login_password = VMware1! {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.896215] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.896347] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.896483] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] nova.auth_section = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.896623] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] nova.auth_type = password {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.896758] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.896883] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] nova.certfile = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.897026] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] nova.collect_timing = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.897156] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] nova.endpoint_type = public {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.897283] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] nova.insecure = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.897412] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] nova.keyfile = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.897553] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] nova.region_name = RegionOne {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.897682] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] nova.split_loggers = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.897807] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] nova.timeout = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.897937] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] placement.auth_section = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.898084] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] placement.auth_type = password {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.898221] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.898346] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] placement.certfile = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.898475] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] placement.collect_timing = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.898608] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] placement.endpoint_type = public {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.898993] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] placement.insecure = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.898993] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] placement.keyfile = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.899058] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] placement.region_name = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.899167] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] placement.split_loggers = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.899292] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] placement.timeout = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.899425] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.auth_section = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.899584] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.auth_type = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.899669] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.cafile = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.899792] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.certfile = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.899918] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.collect_timing = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.900066] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.connect_retries = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.900255] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.connect_retry_delay = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.900394] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.enable_notifications = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.900522] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.endpoint_override = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.900651] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.insecure = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.900776] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.interface = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.900900] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.keyfile = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.901035] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.max_version = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.901162] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.min_version = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.901285] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.region_name = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.901408] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.retriable_status_codes = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.901554] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.service_name = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.901702] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.service_type = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.901833] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.split_loggers = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.901957] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.status_code_retries = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.902094] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.status_code_retry_delay = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.902220] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.timeout = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.902343] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.valid_interfaces = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.902466] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ironic.version = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.902602] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] cli_script.dry_run = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.902741] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.902877] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.903046] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.903185] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.903316] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.903444] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.903573] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.903700] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.903827] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.903961] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.904097] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.904230] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.904392] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.904536] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.904666] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.904800] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.904927] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.905065] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.905203] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.905330] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.905462] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.905577] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.905720] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.905873] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.906009] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.906143] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.906275] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.906403] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.906530] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.906659] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.906785] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.ssl = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.906917] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.907062] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.907231] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.907373] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.907519] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.ssl_version = {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.907643] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.907783] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_notifications.driver = [] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.907914] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_notifications.retry = -1 {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.908072] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.908203] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] oslo_messaging_notifications.transport_url = **** {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 523.908308] env[65413]: DEBUG oslo_service.backend._eventlet.service [None req-f405c899-34b7-4a26-9f57-527c729c821e None None] ******************************************************************************** {{(pid=65413) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 523.909465] env[65413]: DEBUG neutron.agent.securitygroups_rpc [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Init firewall settings (driver=nsxv3) {{(pid=65413) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 523.910772] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=65413) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 523.911008] env[65413]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] RPC agent_id: nsxm-l-01a.corp.local [ 523.913267] env[65413]: DEBUG dogpile.cache.region [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 523.913392] env[65413]: DEBUG dogpile.lock [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 523.913470] env[65413]: DEBUG dogpile.lock [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 523.913558] env[65413]: DEBUG dogpile.lock [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 523.913646] env[65413]: DEBUG dogpile.cache.region [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 523.913730] env[65413]: DEBUG dogpile.lock [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 523.913853] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 523.935782] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Session token - acquiring [ 523.937265] env[65413]: DEBUG networking_nsxv3.common.locking [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 523.937462] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 523.937541] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 523.937984] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 523.949982] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 524.232817] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 524.254531] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 524.254799] env[65413]: DEBUG dogpile.cache.region [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Cache value generated in 0.341 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 524.254879] env[65413]: DEBUG dogpile.lock [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 524.255039] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Activating Policy API Provider. [ 524.255232] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Looking for the default Infrastructure Rules. [ 524.323308] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Looking for the Default Layer3 Logged Drop Section. [ 524.337938] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 524.338406] env[65413]: DEBUG networking_nsxv3.common.locking [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 524.338592] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquiring lock "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 524.338691] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired lock "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 524.338991] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired external semaphore "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 524.339345] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 524.854604] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.357120] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 525.859647] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Inventory metadata is going to be refreshed. [ 525.859860] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 526.595863] env[65413]: DEBUG networking_nsxv3.common.locking [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.596340] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.596340] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.596530] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.608785] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 526.609672] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.610307] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 526.629257] env[65413]: DEBUG networking_nsxv3.common.locking [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.629488] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.629604] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.630021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.630153] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.630296] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 526.630404] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 526.630504] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 526.650914] env[65413]: DEBUG networking_nsxv3.common.locking [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.651227] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.651227] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.651534] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.651723] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.651866] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 526.673378] env[65413]: DEBUG networking_nsxv3.common.locking [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.673636] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.673681] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.673967] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.674126] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.674267] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 526.692400] env[65413]: DEBUG networking_nsxv3.common.locking [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.692595] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquiring lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.692842] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.692948] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired external semaphore "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.693091] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Releasing lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.693233] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 526.693334] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 526.693433] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 526.710413] env[65413]: DEBUG networking_nsxv3.common.locking [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.710703] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquiring lock "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.710703] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired lock "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.710953] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired external semaphore "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.711082] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Releasing lock "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.711215] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 526.711311] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 526.711419] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 526.731656] env[65413]: DEBUG networking_nsxv3.common.locking [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.731881] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.731925] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.732220] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.732352] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.732496] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 526.732597] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 526.732690] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Inventory metadata have been refreshed. [ 526.732782] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Dryrun:True. Metadata refresh completed. [ 526.732937] env[65413]: DEBUG oslo_concurrency.lockutils [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Releasing lock "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.734564] env[65413]: INFO neutron.agent.agent_extensions_manager [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Loaded agent extensions: [] [ 526.735250] env[65413]: DEBUG neutron_lib.callbacks.manager [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=65413) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 526.790259] env[65413]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] NSXv3 Agent Agent RPC Daemon Started! [ 526.790449] env[65413]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] NSXv3 Agent Agent loop - iteration:0 started [ 526.790449] env[65413]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] NSXv3 Agent Agent out of sync with plugin! [ 531.735858] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 531.735858] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 536.737518] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 536.737915] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 541.738988] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 541.738988] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 541.895142] env[65413]: INFO networking_nsxv3.common.synchronization [None req-e697be35-b6bb-4129-9d1d-b011bb5512e1 demo admin] Enqueued Resource ID: 0e7dc7c3-47e0-43c6-9759-74d2d4352ced with Priority: HIGHEST for action security_group_rules [ 541.895696] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e7dc7c3-47e0-43c6-9759-74d2d4352ced with Priority: HIGHEST for action security_group_rules [ 541.896042] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e7dc7c3-47e0-43c6-9759-74d2d4352ced taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.896180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e7dc7c3-47e0-43c6-9759-74d2d4352ced" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.896251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e7dc7c3-47e0-43c6-9759-74d2d4352ced" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.896598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e7dc7c3-47e0-43c6-9759-74d2d4352ced" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.896680] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e7dc7c3-47e0-43c6-9759-74d2d4352ced',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.487746] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.487989] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.487989] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.488208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.488307] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 542.488377] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e7dc7c3-47e0-43c6-9759-74d2d4352ced already deleted. [ 542.488481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e7dc7c3-47e0-43c6-9759-74d2d4352ced" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.896654] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 546.896654] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 551.898102] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 551.898102] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 556.899057] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 556.899057] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 561.900173] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 561.900594] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 566.902453] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 566.902453] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 569.698025] env[65413]: INFO networking_nsxv3.common.synchronization [None req-7766e518-7118-4845-8bb3-b92e36c4174d None None] Enqueued Resource ID: 85d6d0b0-1557-486d-b5ae-cce61be5e684 with Priority: HIGHEST for action port [ 569.698903] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d6d0b0-1557-486d-b5ae-cce61be5e684 with Priority: HIGHEST for action port [ 569.699274] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-85d6d0b0-1557-486d-b5ae-cce61be5e684 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 569.699753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85d6d0b0-1557-486d-b5ae-cce61be5e684" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 569.699753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85d6d0b0-1557-486d-b5ae-cce61be5e684" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 569.699753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85d6d0b0-1557-486d-b5ae-cce61be5e684" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 569.699753] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85d6d0b0-1557-486d-b5ae-cce61be5e684',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 570.202031] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85d6d0b0-1557-486d-b5ae-cce61be5e684 [ 570.202285] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 570.202422] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 570.202492] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 570.202722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 570.202782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 570.202880] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85d6d0b0-1557-486d-b5ae-cce61be5e684 already deleted. [ 570.202936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85d6d0b0-1557-486d-b5ae-cce61be5e684" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.089682] env[65413]: INFO networking_nsxv3.common.synchronization [None req-8689813a-b894-42a3-9020-bdc4fa8526a0 None None] Enqueued Resource ID: 537d339d-284e-4d76-9a84-1a6d7a503f9d with Priority: HIGHEST for action port [ 571.090412] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 537d339d-284e-4d76-9a84-1a6d7a503f9d with Priority: HIGHEST for action port [ 571.090523] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-537d339d-284e-4d76-9a84-1a6d7a503f9d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.090700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-537d339d-284e-4d76-9a84-1a6d7a503f9d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.090700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-537d339d-284e-4d76-9a84-1a6d7a503f9d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.090976] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-537d339d-284e-4d76-9a84-1a6d7a503f9d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.091052] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('537d339d-284e-4d76-9a84-1a6d7a503f9d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 571.593444] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 537d339d-284e-4d76-9a84-1a6d7a503f9d [ 571.593617] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.593967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.593967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.594136] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.594136] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 571.594279] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:537d339d-284e-4d76-9a84-1a6d7a503f9d already deleted. [ 571.594318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-537d339d-284e-4d76-9a84-1a6d7a503f9d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.691366] env[65413]: INFO networking_nsxv3.common.synchronization [None req-2e78482b-c3f6-4f25-8222-395f2ddb615b None None] Enqueued Resource ID: 656d02d2-7074-4781-91d1-95104b75105d with Priority: HIGHEST for action port [ 572.691613] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 656d02d2-7074-4781-91d1-95104b75105d with Priority: HIGHEST for action port [ 572.692332] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-656d02d2-7074-4781-91d1-95104b75105d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.692332] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-656d02d2-7074-4781-91d1-95104b75105d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.692332] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-656d02d2-7074-4781-91d1-95104b75105d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.692723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-656d02d2-7074-4781-91d1-95104b75105d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.694098] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('656d02d2-7074-4781-91d1-95104b75105d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.000450] env[65413]: INFO networking_nsxv3.common.synchronization [None req-37bbef96-9a0e-4bce-9b29-0499ca16e195 None None] Enqueued Resource ID: 0b7d91f0-9021-491d-b7e2-babf33e4d0df with Priority: HIGHEST for action port [ 573.003130] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b7d91f0-9021-491d-b7e2-babf33e4d0df with Priority: HIGHEST for action port [ 573.003130] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b7d91f0-9021-491d-b7e2-babf33e4d0df taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.003130] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b7d91f0-9021-491d-b7e2-babf33e4d0df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.003130] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b7d91f0-9021-491d-b7e2-babf33e4d0df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.003130] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b7d91f0-9021-491d-b7e2-babf33e4d0df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.003130] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b7d91f0-9021-491d-b7e2-babf33e4d0df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.196580] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 656d02d2-7074-4781-91d1-95104b75105d [ 573.196580] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.196989] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.196989] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.197073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.197981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.197981] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:656d02d2-7074-4781-91d1-95104b75105d already deleted. [ 573.197981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-656d02d2-7074-4781-91d1-95104b75105d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.504662] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b7d91f0-9021-491d-b7e2-babf33e4d0df [ 573.504919] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.505067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.505145] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.505352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.505436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.505523] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b7d91f0-9021-491d-b7e2-babf33e4d0df already deleted. [ 573.505599] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b7d91f0-9021-491d-b7e2-babf33e4d0df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 573.892898] env[65413]: INFO networking_nsxv3.common.synchronization [None req-7fdbe7a9-8d64-4cec-a23b-952356ccf571 None None] Enqueued Resource ID: 9fda4974-9041-41b3-b193-44342d54b0ff with Priority: HIGHEST for action port [ 573.893196] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9fda4974-9041-41b3-b193-44342d54b0ff with Priority: HIGHEST for action port [ 573.893704] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-9fda4974-9041-41b3-b193-44342d54b0ff taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.893821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9fda4974-9041-41b3-b193-44342d54b0ff" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.893890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9fda4974-9041-41b3-b193-44342d54b0ff" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.894952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9fda4974-9041-41b3-b193-44342d54b0ff" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.895322] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9fda4974-9041-41b3-b193-44342d54b0ff',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 573.982170] env[65413]: INFO networking_nsxv3.common.synchronization [None req-18dad5fa-62f1-4687-954e-d8d39bb42197 None None] Enqueued Resource ID: 284ba3f8-2974-476a-b38f-842faff523c2 with Priority: HIGHEST for action port [ 573.982170] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 284ba3f8-2974-476a-b38f-842faff523c2 with Priority: HIGHEST for action port [ 573.982565] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-284ba3f8-2974-476a-b38f-842faff523c2 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 573.982891] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-284ba3f8-2974-476a-b38f-842faff523c2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 573.983245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-284ba3f8-2974-476a-b38f-842faff523c2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 573.983822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-284ba3f8-2974-476a-b38f-842faff523c2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 573.984021] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('284ba3f8-2974-476a-b38f-842faff523c2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 574.397637] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9fda4974-9041-41b3-b193-44342d54b0ff [ 574.398056] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.398474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.398791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.398791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.398880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.398965] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9fda4974-9041-41b3-b193-44342d54b0ff already deleted. [ 574.399060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9fda4974-9041-41b3-b193-44342d54b0ff" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.489043] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 284ba3f8-2974-476a-b38f-842faff523c2 [ 574.489215] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.489520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.489520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.489716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.489847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.489943] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:284ba3f8-2974-476a-b38f-842faff523c2 already deleted. [ 574.490037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-284ba3f8-2974-476a-b38f-842faff523c2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.152175] env[65413]: INFO networking_nsxv3.common.synchronization [None req-7079b1da-c6d1-40d0-9b9e-9bb12db8a249 None None] Enqueued Resource ID: 68b4ad31-5b9f-4893-a3ee-ceb3a41ec852 with Priority: HIGHEST for action port [ 575.152436] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68b4ad31-5b9f-4893-a3ee-ceb3a41ec852 with Priority: HIGHEST for action port [ 575.152996] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-68b4ad31-5b9f-4893-a3ee-ceb3a41ec852 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.153126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68b4ad31-5b9f-4893-a3ee-ceb3a41ec852" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.153194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68b4ad31-5b9f-4893-a3ee-ceb3a41ec852" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.153891] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68b4ad31-5b9f-4893-a3ee-ceb3a41ec852" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.154208] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68b4ad31-5b9f-4893-a3ee-ceb3a41ec852',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.657321] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68b4ad31-5b9f-4893-a3ee-ceb3a41ec852 [ 575.657552] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.659025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.659025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.659025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.659025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.659025] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68b4ad31-5b9f-4893-a3ee-ceb3a41ec852 already deleted. [ 575.659025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68b4ad31-5b9f-4893-a3ee-ceb3a41ec852" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.248274] env[65413]: INFO networking_nsxv3.common.synchronization [None req-888c61f4-935d-4fde-acae-ce89f4559c90 None None] Enqueued Resource ID: 7c290be2-c94c-46f5-ac46-a48757102498 with Priority: HIGHEST for action port [ 576.248576] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c290be2-c94c-46f5-ac46-a48757102498 with Priority: HIGHEST for action port [ 576.249261] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c290be2-c94c-46f5-ac46-a48757102498 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.249261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c290be2-c94c-46f5-ac46-a48757102498" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.249597] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c290be2-c94c-46f5-ac46-a48757102498" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.249597] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c290be2-c94c-46f5-ac46-a48757102498" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.249699] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c290be2-c94c-46f5-ac46-a48757102498',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.754449] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c290be2-c94c-46f5-ac46-a48757102498 [ 576.754750] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.755360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.755360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.755360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.755360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.755601] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c290be2-c94c-46f5-ac46-a48757102498 already deleted. [ 576.755922] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c290be2-c94c-46f5-ac46-a48757102498" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.112595] env[65413]: INFO networking_nsxv3.common.synchronization [None req-973c9357-d888-46e1-8670-b299ab10ecd6 None None] Enqueued Resource ID: 68e1147c-5d8f-4cf7-af84-b0a8210621ed with Priority: HIGHEST for action port [ 577.112595] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e1147c-5d8f-4cf7-af84-b0a8210621ed with Priority: HIGHEST for action port [ 577.112862] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-68e1147c-5d8f-4cf7-af84-b0a8210621ed taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.113029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68e1147c-5d8f-4cf7-af84-b0a8210621ed" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.113091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68e1147c-5d8f-4cf7-af84-b0a8210621ed" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.113353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68e1147c-5d8f-4cf7-af84-b0a8210621ed" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.113436] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68e1147c-5d8f-4cf7-af84-b0a8210621ed',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.615806] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68e1147c-5d8f-4cf7-af84-b0a8210621ed [ 577.616170] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.616250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.616407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.617834] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.617834] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.617834] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68e1147c-5d8f-4cf7-af84-b0a8210621ed already deleted. [ 577.617834] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68e1147c-5d8f-4cf7-af84-b0a8210621ed" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.625377] env[65413]: INFO networking_nsxv3.common.synchronization [None req-450de069-cf57-4b28-adf4-f32ba9d23d55 None None] Enqueued Resource ID: baea97cc-d1c9-4857-a2d4-797ed2c7d930 with Priority: HIGHEST for action port [ 577.625635] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: baea97cc-d1c9-4857-a2d4-797ed2c7d930 with Priority: HIGHEST for action port [ 577.626204] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-baea97cc-d1c9-4857-a2d4-797ed2c7d930 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.626347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-baea97cc-d1c9-4857-a2d4-797ed2c7d930" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.626644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-baea97cc-d1c9-4857-a2d4-797ed2c7d930" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.626717] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-baea97cc-d1c9-4857-a2d4-797ed2c7d930" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.626801] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('baea97cc-d1c9-4857-a2d4-797ed2c7d930',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.129396] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port baea97cc-d1c9-4857-a2d4-797ed2c7d930 [ 578.129586] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.129724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.129795] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.130605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.130716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.130973] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:baea97cc-d1c9-4857-a2d4-797ed2c7d930 already deleted. [ 578.131109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-baea97cc-d1c9-4857-a2d4-797ed2c7d930" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.655091] env[65413]: INFO networking_nsxv3.common.synchronization [None req-2d8396f1-4e64-4cb7-abdf-e3381e6de3fe None None] Enqueued Resource ID: 31dc225d-51ce-40a7-9f54-e8ea754e6f7a with Priority: HIGHEST for action port [ 578.655091] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31dc225d-51ce-40a7-9f54-e8ea754e6f7a with Priority: HIGHEST for action port [ 578.655091] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-31dc225d-51ce-40a7-9f54-e8ea754e6f7a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.655091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31dc225d-51ce-40a7-9f54-e8ea754e6f7a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.655091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31dc225d-51ce-40a7-9f54-e8ea754e6f7a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.655542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31dc225d-51ce-40a7-9f54-e8ea754e6f7a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.655542] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31dc225d-51ce-40a7-9f54-e8ea754e6f7a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.157394] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31dc225d-51ce-40a7-9f54-e8ea754e6f7a [ 579.157621] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.157862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.157862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.158038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.158134] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.158232] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31dc225d-51ce-40a7-9f54-e8ea754e6f7a already deleted. [ 579.158320] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31dc225d-51ce-40a7-9f54-e8ea754e6f7a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.364115] env[65413]: INFO networking_nsxv3.common.synchronization [None req-c56e9c06-d0d3-4e2c-86cd-4e96ec2bb450 None None] Enqueued Resource ID: 1335daa8-c7fe-4067-85ad-58c8842e0cde with Priority: HIGHEST for action port [ 579.364115] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1335daa8-c7fe-4067-85ad-58c8842e0cde with Priority: HIGHEST for action port [ 579.364353] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-1335daa8-c7fe-4067-85ad-58c8842e0cde taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.364582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1335daa8-c7fe-4067-85ad-58c8842e0cde" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.364582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1335daa8-c7fe-4067-85ad-58c8842e0cde" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.364836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1335daa8-c7fe-4067-85ad-58c8842e0cde" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.364836] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1335daa8-c7fe-4067-85ad-58c8842e0cde',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.869505] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1335daa8-c7fe-4067-85ad-58c8842e0cde [ 579.869505] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.869505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.869505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.869505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.869505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.869505] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1335daa8-c7fe-4067-85ad-58c8842e0cde already deleted. [ 579.869505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1335daa8-c7fe-4067-85ad-58c8842e0cde" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.211714] env[65413]: INFO networking_nsxv3.common.synchronization [None req-794dbbca-31b1-415e-9733-70bbfabdda7d None None] Enqueued Resource ID: 47e9a6e4-dc75-4946-b25c-203e987081f5 with Priority: HIGHEST for action port [ 580.211714] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47e9a6e4-dc75-4946-b25c-203e987081f5 with Priority: HIGHEST for action port [ 580.211714] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-47e9a6e4-dc75-4946-b25c-203e987081f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.211714] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47e9a6e4-dc75-4946-b25c-203e987081f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.211714] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47e9a6e4-dc75-4946-b25c-203e987081f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.212367] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47e9a6e4-dc75-4946-b25c-203e987081f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.212602] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47e9a6e4-dc75-4946-b25c-203e987081f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.514228] env[65413]: INFO networking_nsxv3.common.synchronization [None req-a95f8064-c42c-4ea9-bcf9-70c8a3608572 None None] Enqueued Resource ID: 92050d62-1c5e-4795-9cf2-72d39c93a3c2 with Priority: HIGHEST for action port [ 580.514490] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92050d62-1c5e-4795-9cf2-72d39c93a3c2 with Priority: HIGHEST for action port [ 580.515075] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-92050d62-1c5e-4795-9cf2-72d39c93a3c2 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.515207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92050d62-1c5e-4795-9cf2-72d39c93a3c2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.515287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92050d62-1c5e-4795-9cf2-72d39c93a3c2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.516664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92050d62-1c5e-4795-9cf2-72d39c93a3c2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.516757] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92050d62-1c5e-4795-9cf2-72d39c93a3c2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.715598] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47e9a6e4-dc75-4946-b25c-203e987081f5 [ 580.715994] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.716105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.716105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.716357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.716450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.716551] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47e9a6e4-dc75-4946-b25c-203e987081f5 already deleted. [ 580.717571] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47e9a6e4-dc75-4946-b25c-203e987081f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.018852] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92050d62-1c5e-4795-9cf2-72d39c93a3c2 [ 581.019165] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.020358] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.020358] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.020358] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.020358] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.020358] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92050d62-1c5e-4795-9cf2-72d39c93a3c2 already deleted. [ 581.020585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92050d62-1c5e-4795-9cf2-72d39c93a3c2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.573359] env[65413]: INFO networking_nsxv3.common.synchronization [None req-33580517-2817-40ee-b3c4-05310b548791 None None] Enqueued Resource ID: 7321991a-8a6e-4a81-b021-dd943d7f93a9 with Priority: HIGHEST for action port [ 581.573607] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7321991a-8a6e-4a81-b021-dd943d7f93a9 with Priority: HIGHEST for action port [ 581.574176] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-7321991a-8a6e-4a81-b021-dd943d7f93a9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.574342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7321991a-8a6e-4a81-b021-dd943d7f93a9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.574406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7321991a-8a6e-4a81-b021-dd943d7f93a9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.574633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7321991a-8a6e-4a81-b021-dd943d7f93a9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.574707] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7321991a-8a6e-4a81-b021-dd943d7f93a9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.077266] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7321991a-8a6e-4a81-b021-dd943d7f93a9 [ 582.077511] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.077511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.077612] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.077801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.077885] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.077982] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7321991a-8a6e-4a81-b021-dd943d7f93a9 already deleted. [ 582.078082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7321991a-8a6e-4a81-b021-dd943d7f93a9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.583698] env[65413]: INFO networking_nsxv3.common.synchronization [None req-91015362-fb3a-4ae3-bce7-84f3fc9c8686 None None] Enqueued Resource ID: 06e53443-6a9e-4e9c-a7f9-38c10c09f449 with Priority: HIGHEST for action port [ 582.583698] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06e53443-6a9e-4e9c-a7f9-38c10c09f449 with Priority: HIGHEST for action port [ 582.584119] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-06e53443-6a9e-4e9c-a7f9-38c10c09f449 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.584275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06e53443-6a9e-4e9c-a7f9-38c10c09f449" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.585193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06e53443-6a9e-4e9c-a7f9-38c10c09f449" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.585193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06e53443-6a9e-4e9c-a7f9-38c10c09f449" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.585193] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06e53443-6a9e-4e9c-a7f9-38c10c09f449',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.703142] env[65413]: INFO networking_nsxv3.common.synchronization [req-1901f63e-7e25-4556-b40b-08a54da47000 req-ae76eef4-9400-4748-900f-aeb4ea46b8ed tempest-MigrationsAdminTest-1569866777 tempest-MigrationsAdminTest-1569866777-project-member] Enqueued Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_members [ 582.703670] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_members [ 582.703961] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.704100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.704162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.707488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.707705] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.707925] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.707925] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.708819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.708819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.708939] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.088995] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06e53443-6a9e-4e9c-a7f9-38c10c09f449 [ 583.089291] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.090879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.090879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.090879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.090879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.090879] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06e53443-6a9e-4e9c-a7f9-38c10c09f449 already deleted. [ 583.090879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06e53443-6a9e-4e9c-a7f9-38c10c09f449" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.111618] env[65413]: INFO networking_nsxv3.common.synchronization [None req-082fc9c6-e465-4d2e-92f2-a4f40bbd162d None None] Enqueued Resource ID: 65422297-48c0-49ce-93ec-b3f054904894 with Priority: HIGHEST for action port [ 583.111714] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65422297-48c0-49ce-93ec-b3f054904894 with Priority: HIGHEST for action port [ 583.112659] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-65422297-48c0-49ce-93ec-b3f054904894 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.112659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65422297-48c0-49ce-93ec-b3f054904894" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.112659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65422297-48c0-49ce-93ec-b3f054904894" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.112659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65422297-48c0-49ce-93ec-b3f054904894" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.112833] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65422297-48c0-49ce-93ec-b3f054904894',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.211917] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.212547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.212547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.212547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.212547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.212710] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.212777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.212807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.212944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.213032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.213162] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af248d88-efaa-44cd-99ca-972413455b63 already deleted. [ 583.213202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.521079] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.521079] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.521079] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.521955] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.524307] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.524307] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.524307] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.524307] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.524307] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.524307] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.524307] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 583.524307] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 583.524307] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 583.524307] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 583.524307] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 583.524307] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 583.545621] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 583.545801] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 583.545950] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 583.546127] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.546460] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-d963ca55-ee3f-4889-883d-5ab574d0fe4d taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.546633] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-d963ca55-ee3f-4889-883d-5ab574d0fe4d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.546751] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-d963ca55-ee3f-4889-883d-5ab574d0fe4d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.547099] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-d963ca55-ee3f-4889-883d-5ab574d0fe4d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.547240] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d963ca55-ee3f-4889-883d-5ab574d0fe4d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.617532] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 65422297-48c0-49ce-93ec-b3f054904894 [ 583.617722] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.617778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.617875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.618055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.618147] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.618273] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:65422297-48c0-49ce-93ec-b3f054904894 already deleted. [ 583.618389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65422297-48c0-49ce-93ec-b3f054904894" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.739830] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.739830] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.739830] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.739830] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.739830] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.937064] env[65413]: INFO networking_nsxv3.common.synchronization [None req-a01c6b93-1a29-45be-96c6-ae2c19477b17 None None] Enqueued Resource ID: 0154c9a1-692c-480f-b560-e69d9775a770 with Priority: HIGHEST for action port [ 583.937589] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0154c9a1-692c-480f-b560-e69d9775a770 with Priority: HIGHEST for action port [ 583.937881] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0154c9a1-692c-480f-b560-e69d9775a770 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.938020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0154c9a1-692c-480f-b560-e69d9775a770" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.938140] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0154c9a1-692c-480f-b560-e69d9775a770" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.938506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0154c9a1-692c-480f-b560-e69d9775a770" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.938602] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0154c9a1-692c-480f-b560-e69d9775a770',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.051170] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.051170] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.051170] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.051170] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.051170] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.051451] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port d963ca55-ee3f-4889-883d-5ab574d0fe4d not found, creating... [ 584.051535] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.051688] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.051796] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.052029] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.052160] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.052524] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.052669] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.052779] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.052975] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.053168] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.053310] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: d963ca55-ee3f-4889-883d-5ab574d0fe4d is going to be created. [ 584.076572] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.076782] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.076902] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.077198] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.077420] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.077638] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-d963ca55-ee3f-4889-883d-5ab574d0fe4d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.243207] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.435262] env[65413]: INFO networking_nsxv3.common.synchronization [None req-6957b7dd-8b51-4f47-aced-b5525727e67f None None] Enqueued Resource ID: 8bca63a5-031f-48d0-b2c8-a39397a3da15 with Priority: HIGHEST for action port [ 584.435852] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bca63a5-031f-48d0-b2c8-a39397a3da15 with Priority: HIGHEST for action port [ 584.436487] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bca63a5-031f-48d0-b2c8-a39397a3da15 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.436626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bca63a5-031f-48d0-b2c8-a39397a3da15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.436702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bca63a5-031f-48d0-b2c8-a39397a3da15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.436955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bca63a5-031f-48d0-b2c8-a39397a3da15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.437121] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bca63a5-031f-48d0-b2c8-a39397a3da15',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.441033] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0154c9a1-692c-480f-b560-e69d9775a770 [ 584.441033] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.441033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.441033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.441033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.441033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.441033] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0154c9a1-692c-480f-b560-e69d9775a770 already deleted. [ 584.441033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0154c9a1-692c-480f-b560-e69d9775a770" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.462759] env[65413]: INFO networking_nsxv3.common.synchronization [req-d4e56bb9-2a14-4dee-a285-2e5c08536753 req-4fc696f6-8f41-45ee-816a-ec3cd8478a66 tempest-DeleteServersAdminTestJSON-65358818 tempest-DeleteServersAdminTestJSON-65358818-project-member] Enqueued Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_members [ 584.463264] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_members [ 584.463575] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d03374-02a8-4013-ba8d-fa57c3795178 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.463698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.463764] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.464014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.464348] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.464499] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.464586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.464775] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.464883] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.465059] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.749271] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.943294] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8bca63a5-031f-48d0-b2c8-a39397a3da15 [ 584.943510] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.943659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.943729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.943948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.944055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.944256] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8bca63a5-031f-48d0-b2c8-a39397a3da15 already deleted. [ 584.944256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bca63a5-031f-48d0-b2c8-a39397a3da15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.961290] env[65413]: INFO networking_nsxv3.common.synchronization [req-1901f63e-7e25-4556-b40b-08a54da47000 req-a7b46873-0d4c-49b4-81ed-a984c2d67c92 service nova] Enqueued Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_rules [ 584.961290] env[65413]: INFO networking_nsxv3.common.synchronization [req-1901f63e-7e25-4556-b40b-08a54da47000 req-a7b46873-0d4c-49b4-81ed-a984c2d67c92 service nova] Enqueued Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_members [ 584.961290] env[65413]: INFO networking_nsxv3.common.synchronization [req-1901f63e-7e25-4556-b40b-08a54da47000 req-a7b46873-0d4c-49b4-81ed-a984c2d67c92 service nova] Enqueued Resource ID: d963ca55-ee3f-4889-883d-5ab574d0fe4d with Priority: HIGHEST for action port [ 584.961290] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_rules [ 584.961290] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_members [ 584.961290] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d963ca55-ee3f-4889-883d-5ab574d0fe4d with Priority: HIGHEST for action port [ 584.962134] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.962134] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.962134] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.962775] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.962775] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.964058] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.964277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.964277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.964478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.964780] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.964780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.964917] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.965311] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.965311] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.965311] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.966616] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-d963ca55-ee3f-4889-883d-5ab574d0fe4d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.966716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d963ca55-ee3f-4889-883d-5ab574d0fe4d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.966856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d963ca55-ee3f-4889-883d-5ab574d0fe4d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.966917] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d963ca55-ee3f-4889-883d-5ab574d0fe4d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.966987] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d963ca55-ee3f-4889-883d-5ab574d0fe4d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.970065] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.970065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.970065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.970065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.970338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.970877] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.970877] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.971376] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.971376] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.971376] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.971765] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d03374-02a8-4013-ba8d-fa57c3795178 already deleted. [ 584.971765] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.154238] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.154704] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.154879] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.156031] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.156337] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.156500] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.156620] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.156824] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.156962] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.157255] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 585.157480] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 585.157638] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 585.157810] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 585.158073] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 585.158228] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 585.158834] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 585.178444] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 585.178715] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 585.178886] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 585.179119] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.179702] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-2352fe32-98a4-4d8a-825e-fba3ba7123a5 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.180493] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-2352fe32-98a4-4d8a-825e-fba3ba7123a5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.181387] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-2352fe32-98a4-4d8a-825e-fba3ba7123a5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.181827] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-2352fe32-98a4-4d8a-825e-fba3ba7123a5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.181827] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2352fe32-98a4-4d8a-825e-fba3ba7123a5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.252138] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 585.252362] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 585.473214] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.473214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.484348] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d963ca55-ee3f-4889-883d-5ab574d0fe4d with status ACTIVE [ 585.485052] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.485312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.485432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.485676] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.485785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.485976] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.486095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.486161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.486374] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.486461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.486646] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.486744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.486807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.486953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.489249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.489249] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d963ca55-ee3f-4889-883d-5ab574d0fe4d is going to be updated. [ 585.490868] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.521738] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.521959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.521959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.522195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.522334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.522495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d963ca55-ee3f-4889-883d-5ab574d0fe4d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.686676] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.686911] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.687047] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.687463] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.687617] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.688637] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 2352fe32-98a4-4d8a-825e-fba3ba7123a5 not found, creating... [ 585.688637] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.688637] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.688637] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.688911] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.688911] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.689181] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.690369] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.690369] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.690369] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.690369] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.690369] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 2352fe32-98a4-4d8a-825e-fba3ba7123a5 is going to be created. [ 585.713081] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.713349] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.713519] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.714116] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.714414] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.714640] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-2352fe32-98a4-4d8a-825e-fba3ba7123a5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.761478] env[65413]: INFO networking_nsxv3.common.synchronization [None req-c378a74f-431b-4c3c-b300-3c62221c522a None None] Enqueued Resource ID: 57ac3ce8-06ab-4233-a233-adeca33c368f with Priority: HIGHEST for action port [ 585.762028] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57ac3ce8-06ab-4233-a233-adeca33c368f with Priority: HIGHEST for action port [ 585.762326] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-57ac3ce8-06ab-4233-a233-adeca33c368f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.762582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57ac3ce8-06ab-4233-a233-adeca33c368f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.762582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57ac3ce8-06ab-4233-a233-adeca33c368f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.762759] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57ac3ce8-06ab-4233-a233-adeca33c368f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.762839] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57ac3ce8-06ab-4233-a233-adeca33c368f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.996677] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.237357] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.241021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.241021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.241021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.250786] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 586.253323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.254299] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 586.266862] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 57ac3ce8-06ab-4233-a233-adeca33c368f [ 586.266862] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.266862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.266862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.267123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.267218] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.267283] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:57ac3ce8-06ab-4233-a233-adeca33c368f already deleted. [ 586.267338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57ac3ce8-06ab-4233-a233-adeca33c368f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.273621] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.274428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.274428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.274428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.274428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.274667] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 586.274667] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.274667] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 586.279351] env[65413]: INFO networking_nsxv3.common.synchronization [None req-7cd69a41-e921-40e1-9d20-c47afae016b7 None None] Enqueued Resource ID: cf58a475-dc37-47e5-93f5-9e58860e36d4 with Priority: HIGHEST for action port [ 586.279596] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf58a475-dc37-47e5-93f5-9e58860e36d4 with Priority: HIGHEST for action port [ 586.279890] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf58a475-dc37-47e5-93f5-9e58860e36d4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.282101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf58a475-dc37-47e5-93f5-9e58860e36d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.282101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf58a475-dc37-47e5-93f5-9e58860e36d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.282101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf58a475-dc37-47e5-93f5-9e58860e36d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.282101] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf58a475-dc37-47e5-93f5-9e58860e36d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.300041] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.300219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.300273] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.300482] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.300630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.300752] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 586.325251] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.325478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.325524] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.327287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.327287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.327287] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 586.350755] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.350909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.350968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.351206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.351311] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.351428] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 586.351498] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.351569] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 586.369944] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.369944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.369944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.370390] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.370390] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.370390] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 586.370668] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.370668] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 586.392279] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.392463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.392508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.392689] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.392789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.392907] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 586.393032] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 586.393078] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 586.393152] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 586.393222] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 586.393279] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 586.393332] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 586.393615] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 586.393672] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 586.393741] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 586.414436] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.414662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.414742] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.415405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.415405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.415405] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 586.435561] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.435705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.435774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.438066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.438066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.451479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.502565] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.502777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.502777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.502995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.503095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.503185] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af248d88-efaa-44cd-99ca-972413455b63 is going to be created. [ 586.529575] env[65413]: INFO networking_nsxv3.common.synchronization [req-d4e56bb9-2a14-4dee-a285-2e5c08536753 req-cdf662c4-9ba7-4c74-9d4a-e685cb3dad80 service nova] Enqueued Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_rules [ 586.529743] env[65413]: INFO networking_nsxv3.common.synchronization [req-d4e56bb9-2a14-4dee-a285-2e5c08536753 req-cdf662c4-9ba7-4c74-9d4a-e685cb3dad80 service nova] Enqueued Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_members [ 586.529871] env[65413]: INFO networking_nsxv3.common.synchronization [req-d4e56bb9-2a14-4dee-a285-2e5c08536753 req-cdf662c4-9ba7-4c74-9d4a-e685cb3dad80 service nova] Enqueued Resource ID: 2352fe32-98a4-4d8a-825e-fba3ba7123a5 with Priority: HIGHEST for action port [ 586.530982] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.533139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.533851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.533851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.533851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.535586] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_rules [ 586.535745] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_members [ 586.535843] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2352fe32-98a4-4d8a-825e-fba3ba7123a5 with Priority: HIGHEST for action port [ 586.536829] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d03374-02a8-4013-ba8d-fa57c3795178 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.536829] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.536829] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.536829] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.536829] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.537643] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d03374-02a8-4013-ba8d-fa57c3795178 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.537804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.537889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.538102] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.539565] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.539565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.539565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.539565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.541128] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.541128] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.541128] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-2352fe32-98a4-4d8a-825e-fba3ba7123a5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.541128] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2352fe32-98a4-4d8a-825e-fba3ba7123a5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.541128] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2352fe32-98a4-4d8a-825e-fba3ba7123a5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.541852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2352fe32-98a4-4d8a-825e-fba3ba7123a5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.541852] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2352fe32-98a4-4d8a-825e-fba3ba7123a5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.554953] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: UNINITIALIZED for 2s [ 586.784122] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf58a475-dc37-47e5-93f5-9e58860e36d4 [ 586.784359] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.784495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.784563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.784772] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.785371] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.785371] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf58a475-dc37-47e5-93f5-9e58860e36d4 already deleted. [ 586.785371] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf58a475-dc37-47e5-93f5-9e58860e36d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.814766] env[65413]: INFO networking_nsxv3.common.synchronization [None req-dc2c0137-1858-41b5-9fff-a3ad88265a88 None None] Enqueued Resource ID: 0178b604-8a6d-4281-b868-571c1c87d7f1 with Priority: HIGHEST for action port [ 586.816678] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0178b604-8a6d-4281-b868-571c1c87d7f1 with Priority: HIGHEST for action port [ 586.817030] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0178b604-8a6d-4281-b868-571c1c87d7f1 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.817164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0178b604-8a6d-4281-b868-571c1c87d7f1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.817233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0178b604-8a6d-4281-b868-571c1c87d7f1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.817504] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0178b604-8a6d-4281-b868-571c1c87d7f1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.817577] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0178b604-8a6d-4281-b868-571c1c87d7f1',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.044871] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.045911] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d03374-02a8-4013-ba8d-fa57c3795178 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.046030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.050191] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2352fe32-98a4-4d8a-825e-fba3ba7123a5 with status ACTIVE [ 587.050191] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.050191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.050191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.050191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.050191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.050191] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.050191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.050191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.050191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.050191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.050191] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.050191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.050191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.050191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.050191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.050191] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2352fe32-98a4-4d8a-825e-fba3ba7123a5 is going to be updated. [ 587.073158] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.073434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.073434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.073567] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.073700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.073855] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2352fe32-98a4-4d8a-825e-fba3ba7123a5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.323050] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0178b604-8a6d-4281-b868-571c1c87d7f1 [ 587.323309] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.323435] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.323505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.323736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.323827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.323923] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0178b604-8a6d-4281-b868-571c1c87d7f1 already deleted. [ 587.324011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0178b604-8a6d-4281-b868-571c1c87d7f1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.550131] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.057719] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.057719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.057719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.057719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.057719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.057719] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d03374-02a8-4013-ba8d-fa57c3795178 is going to be created. [ 588.083010] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.083010] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.083010] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.083010] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.083010] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.095870] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d03374-02a8-4013-ba8d-fa57c3795178 in Status: UNINITIALIZED for 2s [ 588.418721] env[65413]: INFO networking_nsxv3.common.synchronization [None req-e4c41796-9db5-47b8-afde-27a83f69db6d tempest-ServerActionsTestJSON-1087044681 tempest-ServerActionsTestJSON-1087044681-project-member] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_rules [ 588.420905] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_rules [ 588.421122] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.423142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.423142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.423142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.423142] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.553437] env[65413]: INFO networking_nsxv3.common.synchronization [None req-bec6e74a-a19a-418c-9089-8f45c65b1b3d tempest-ServerActionsTestJSON-1087044681 tempest-ServerActionsTestJSON-1087044681-project-member] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_rules [ 588.554050] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_rules [ 588.554426] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.554525] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.567507] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: SUCCESS [ 588.567507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.567507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.567758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.567846] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.567919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.567955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.568104] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.568181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.568262] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.568417] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.946388] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.946388] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.946388] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.946711] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.947082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.947082] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef already deleted. [ 588.947177] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.947424] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.948875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.948875] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.071250] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.071423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.071467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.072831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.072831] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.072831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.072831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.072831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.072831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.072831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.072831] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.072831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.072831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.072831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.074558] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.074730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.074797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.074963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.075061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.075150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.075243] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.475202] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.475604] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.475604] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.475703] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.475755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.475824] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef already deleted. [ 589.475894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.579794] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af248d88-efaa-44cd-99ca-972413455b63: rpc.has_security_group_logging(os_id): False [ 589.620414] env[65413]: INFO networking_nsxv3.common.synchronization [None req-0315ffc8-68fd-46c3-b8f0-257260ff07c5 tempest-VolumesAssistedSnapshotsTest-1837750333 tempest-VolumesAssistedSnapshotsTest-1837750333-project-member] Enqueued Resource ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 with Priority: HIGHEST for action security_group_rules [ 589.623403] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.623403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.623403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.623403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.623403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.624996] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.624996] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.624996] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.625354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.625501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.625806] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.625959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.626066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.626291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.626409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.626805] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.626963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.627081] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.627491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.627994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.627994] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af248d88-efaa-44cd-99ca-972413455b63 is going to be created. [ 589.630052] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 with Priority: HIGHEST for action security_group_rules [ 589.630520] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7541a263-2861-4b4d-ab51-2db5044fecf7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.630682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.631146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.631146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.631242] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7541a263-2861-4b4d-ab51-2db5044fecf7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.718803] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.718803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.718803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.718803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.718803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.741601] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: IN_PROGRESS for 2s [ 589.911483] env[65413]: INFO networking_nsxv3.common.synchronization [None req-f329144f-2be8-4014-bca1-4ab3cd5296c4 tempest-VolumesAssistedSnapshotsTest-1837750333 tempest-VolumesAssistedSnapshotsTest-1837750333-project-member] Enqueued Resource ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 with Priority: HIGHEST for action security_group_rules [ 589.912126] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 with Priority: HIGHEST for action security_group_rules [ 589.912460] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7541a263-2861-4b4d-ab51-2db5044fecf7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.912625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.106539] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d03374-02a8-4013-ba8d-fa57c3795178 in Status: SUCCESS [ 590.106770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.107071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.107330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.107565] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.107758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.107890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.108173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.108392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.108541] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.108678] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.155976] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.156147] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.156313] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.156595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.156705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.156786] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 already deleted. [ 590.156867] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.157034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.157186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.157268] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7541a263-2861-4b4d-ab51-2db5044fecf7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.615394] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d03374-02a8-4013-ba8d-fa57c3795178 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.615810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.615810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.615952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.619068] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.619068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.619068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.619068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.619068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.619068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.619068] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d03374-02a8-4013-ba8d-fa57c3795178 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.619068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.619068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.619068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.619068] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.619068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.619068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.619068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.619068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.619068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.619068] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.688574] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.688848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.688891] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.689171] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.689880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.689880] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 already deleted. [ 590.689880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.123278] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58d03374-02a8-4013-ba8d-fa57c3795178: rpc.has_security_group_logging(os_id): False [ 591.143835] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.144070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.145038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.145738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.145738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.145738] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.145915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.145915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.147027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.147370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.147821] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.148240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.148240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.148240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.148396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.148732] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.148873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.148972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.149285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.149524] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.149680] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d03374-02a8-4013-ba8d-fa57c3795178 is going to be created. [ 591.224486] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.224624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.224624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.224786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.224970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.235264] env[65413]: INFO networking_nsxv3.common.synchronization [None req-887bb163-fe66-43de-b5c0-df1954aeb0d7 None None] Enqueued Resource ID: a01f59f7-7c0e-4fb6-96ad-3cc5974089a0 with Priority: HIGHEST for action port [ 591.235264] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a01f59f7-7c0e-4fb6-96ad-3cc5974089a0 with Priority: HIGHEST for action port [ 591.238543] env[65413]: INFO networking_nsxv3.common.synchronization [None req-2b8eda2d-815c-42d0-b3b3-f8a0e75cf714 None None] Enqueued Resource ID: 2f39abdb-5a66-4fab-893d-874bb94307d0 with Priority: HIGHEST for action port [ 591.238543] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-a01f59f7-7c0e-4fb6-96ad-3cc5974089a0 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.238543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a01f59f7-7c0e-4fb6-96ad-3cc5974089a0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.238543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a01f59f7-7c0e-4fb6-96ad-3cc5974089a0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.238543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a01f59f7-7c0e-4fb6-96ad-3cc5974089a0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.238837] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a01f59f7-7c0e-4fb6-96ad-3cc5974089a0',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.240909] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f39abdb-5a66-4fab-893d-874bb94307d0 with Priority: HIGHEST for action port [ 591.242253] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d03374-02a8-4013-ba8d-fa57c3795178 in Status: IN_PROGRESS for 2s [ 591.243838] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f39abdb-5a66-4fab-893d-874bb94307d0 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.243838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f39abdb-5a66-4fab-893d-874bb94307d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.243838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f39abdb-5a66-4fab-893d-874bb94307d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.243838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f39abdb-5a66-4fab-893d-874bb94307d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.243838] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f39abdb-5a66-4fab-893d-874bb94307d0',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.741943] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a01f59f7-7c0e-4fb6-96ad-3cc5974089a0 [ 591.742243] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.742443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.742443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.742622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.742713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.742822] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a01f59f7-7c0e-4fb6-96ad-3cc5974089a0 already deleted. [ 591.742905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a01f59f7-7c0e-4fb6-96ad-3cc5974089a0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.745894] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f39abdb-5a66-4fab-893d-874bb94307d0 [ 591.746673] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.746673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.747842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.747842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.747842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.747842] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f39abdb-5a66-4fab-893d-874bb94307d0 already deleted. [ 591.747842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f39abdb-5a66-4fab-893d-874bb94307d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.759601] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: SUCCESS [ 591.760055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.262080] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d03374-02a8-4013-ba8d-fa57c3795178 in Status: SUCCESS [ 593.262080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.646585] env[65413]: INFO networking_nsxv3.common.synchronization [req-252da4ef-19cb-471b-a387-c3408054a571 req-6845bf72-0120-438f-8448-635cacd3a534 tempest-ServerDiagnosticsNegativeTest-1665493519 tempest-ServerDiagnosticsNegativeTest-1665493519-project-member] Enqueued Resource ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 with Priority: HIGHEST for action security_group_members [ 593.646585] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 with Priority: HIGHEST for action security_group_members [ 593.646585] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.646585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.646585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.647466] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.647724] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.648022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.648985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.648985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.648985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.648985] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf0b2b30-620f-460d-be6e-f4b8fb0907c6',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.040195] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.040195] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.040412] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.040598] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.040949] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.041307] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.041406] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.041657] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.041819] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.042064] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.042193] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 594.042307] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 594.042411] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 594.042513] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.042616] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 594.042775] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 594.064767] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 594.065067] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 594.065260] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 594.065487] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.065845] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-e3c34984-95d8-4514-a5bd-1329ce17931f taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.066017] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-e3c34984-95d8-4514-a5bd-1329ce17931f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.066142] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-e3c34984-95d8-4514-a5bd-1329ce17931f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.066479] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-e3c34984-95d8-4514-a5bd-1329ce17931f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.066612] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3c34984-95d8-4514-a5bd-1329ce17931f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.156406] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.156668] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.156729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.156909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.157180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.157299] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.157299] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.157438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.157528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.157619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.157663] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 already deleted. [ 594.157733] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.570355] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.570355] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.570355] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.570814] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.570814] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.571031] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port e3c34984-95d8-4514-a5bd-1329ce17931f not found, creating... [ 594.571187] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.571328] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.571453] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.571643] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.571783] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.572082] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.572234] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.572343] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.572550] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.572677] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.572806] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: e3c34984-95d8-4514-a5bd-1329ce17931f is going to be created. [ 594.596708] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.596912] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.597037] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.597333] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.597555] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.597777] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-e3c34984-95d8-4514-a5bd-1329ce17931f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.292772] env[65413]: INFO networking_nsxv3.common.synchronization [req-252da4ef-19cb-471b-a387-c3408054a571 req-b7632420-5c66-4028-b368-f1c4c07683d1 service nova] Enqueued Resource ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 with Priority: HIGHEST for action security_group_rules [ 595.292937] env[65413]: INFO networking_nsxv3.common.synchronization [req-252da4ef-19cb-471b-a387-c3408054a571 req-b7632420-5c66-4028-b368-f1c4c07683d1 service nova] Enqueued Resource ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 with Priority: HIGHEST for action security_group_members [ 595.293087] env[65413]: INFO networking_nsxv3.common.synchronization [req-252da4ef-19cb-471b-a387-c3408054a571 req-b7632420-5c66-4028-b368-f1c4c07683d1 service nova] Enqueued Resource ID: e3c34984-95d8-4514-a5bd-1329ce17931f with Priority: HIGHEST for action port [ 595.293323] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 with Priority: HIGHEST for action security_group_rules [ 595.293455] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 with Priority: HIGHEST for action security_group_members [ 595.293550] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e3c34984-95d8-4514-a5bd-1329ce17931f with Priority: HIGHEST for action port [ 595.294310] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf0b2b30-620f-460d-be6e-f4b8fb0907c6 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.294449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.294675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.294921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.295122] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf0b2b30-620f-460d-be6e-f4b8fb0907c6',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.297334] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.297448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.297522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.297762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.300105] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.300105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.300105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.300105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.300105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.300105] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf0b2b30-620f-460d-be6e-f4b8fb0907c6',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.300976] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-e3c34984-95d8-4514-a5bd-1329ce17931f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.300976] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e3c34984-95d8-4514-a5bd-1329ce17931f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.300976] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e3c34984-95d8-4514-a5bd-1329ce17931f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.301145] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e3c34984-95d8-4514-a5bd-1329ce17931f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.301283] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e3c34984-95d8-4514-a5bd-1329ce17931f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.797964] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.797964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.800552] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cf0b2b30-620f-460d-be6e-f4b8fb0907c6',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.803529] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e3c34984-95d8-4514-a5bd-1329ce17931f with status ACTIVE [ 595.803529] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.803529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.803529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.803695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.803695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.803892] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.803999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.804073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.804236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.804313] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.804493] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.804650] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.804650] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.804783] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.804856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.804940] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e3c34984-95d8-4514-a5bd-1329ce17931f is going to be updated. [ 595.828015] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.828015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.828015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.828015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.828015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.828274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e3c34984-95d8-4514-a5bd-1329ce17931f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.990245] env[65413]: INFO networking_nsxv3.common.synchronization [req-b4968e8e-c260-432b-b6a3-2d0822efdb4a req-f77dd90e-10d8-421f-b796-7b9500e0df8b tempest-TenantUsagesTestJSON-289145301 tempest-TenantUsagesTestJSON-289145301-project-member] Enqueued Resource ID: fd87052e-7745-4df2-93d7-5efc42c58438 with Priority: HIGHEST for action security_group_members [ 595.990809] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd87052e-7745-4df2-93d7-5efc42c58438 with Priority: HIGHEST for action security_group_members [ 595.991126] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd87052e-7745-4df2-93d7-5efc42c58438 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.991249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.991364] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.991569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.991723] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.991824] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.991882] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.992042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.992131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.992225] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd87052e-7745-4df2-93d7-5efc42c58438',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.287199] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.287981] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.287981] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.287981] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.289571] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.289571] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.289571] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.290160] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.290614] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.291099] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.291348] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 596.291853] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 596.292022] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 596.292167] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.292267] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 596.292397] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 596.302331] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cf0b2b30-620f-460d-be6e-f4b8fb0907c6',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.321699] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 596.321890] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 596.321989] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 596.322190] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.322510] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-947da35d-3735-4215-9a1e-de72e321eb87 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.322681] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-947da35d-3735-4215-9a1e-de72e321eb87" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.322851] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-947da35d-3735-4215-9a1e-de72e321eb87" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.323260] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-947da35d-3735-4215-9a1e-de72e321eb87" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.323449] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('947da35d-3735-4215-9a1e-de72e321eb87',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.494603] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.494839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.494839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.495153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.495250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.495467] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.495607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.495607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.495744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.495821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.495899] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd87052e-7745-4df2-93d7-5efc42c58438 already deleted. [ 596.495974] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.805943] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.806455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.806455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.806455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.806720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.806720] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 is going to be created. [ 596.825815] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.826100] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.826236] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.826558] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.826755] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.826914] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 947da35d-3735-4215-9a1e-de72e321eb87 not found, creating... [ 596.827297] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.827532] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.827697] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.827966] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.828144] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.828525] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.828700] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.828842] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.829351] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.829534] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.829714] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 947da35d-3735-4215-9a1e-de72e321eb87 is going to be created. [ 596.832941] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.833112] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.833217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.833440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.833596] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.843432] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 in Status: UNINITIALIZED for 2s [ 596.850557] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.850775] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.850912] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.851210] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.851433] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.851642] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-947da35d-3735-4215-9a1e-de72e321eb87" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.970062] env[65413]: INFO networking_nsxv3.common.synchronization [None req-829fb559-32ca-4941-9763-89938ef697c6 None None] Enqueued Resource ID: 98d013ed-c329-42de-9245-7f797543c66a with Priority: HIGHEST for action port [ 596.970793] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98d013ed-c329-42de-9245-7f797543c66a with Priority: HIGHEST for action port [ 596.974580] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-98d013ed-c329-42de-9245-7f797543c66a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.974580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98d013ed-c329-42de-9245-7f797543c66a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.974580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98d013ed-c329-42de-9245-7f797543c66a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.974719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98d013ed-c329-42de-9245-7f797543c66a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.974749] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98d013ed-c329-42de-9245-7f797543c66a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.479346] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98d013ed-c329-42de-9245-7f797543c66a [ 597.479591] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.479720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.479794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.480015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.480113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.480201] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98d013ed-c329-42de-9245-7f797543c66a already deleted. [ 597.480556] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98d013ed-c329-42de-9245-7f797543c66a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.580728] env[65413]: INFO networking_nsxv3.common.synchronization [req-b4968e8e-c260-432b-b6a3-2d0822efdb4a req-37f880c9-86fb-44d5-9882-daf6c0784524 service nova] Enqueued Resource ID: fd87052e-7745-4df2-93d7-5efc42c58438 with Priority: HIGHEST for action security_group_rules [ 597.580945] env[65413]: INFO networking_nsxv3.common.synchronization [req-b4968e8e-c260-432b-b6a3-2d0822efdb4a req-37f880c9-86fb-44d5-9882-daf6c0784524 service nova] Enqueued Resource ID: fd87052e-7745-4df2-93d7-5efc42c58438 with Priority: HIGHEST for action security_group_members [ 597.581153] env[65413]: INFO networking_nsxv3.common.synchronization [req-b4968e8e-c260-432b-b6a3-2d0822efdb4a req-37f880c9-86fb-44d5-9882-daf6c0784524 service nova] Enqueued Resource ID: 947da35d-3735-4215-9a1e-de72e321eb87 with Priority: HIGHEST for action port [ 597.581667] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd87052e-7745-4df2-93d7-5efc42c58438 with Priority: HIGHEST for action security_group_rules [ 597.581823] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd87052e-7745-4df2-93d7-5efc42c58438 with Priority: HIGHEST for action security_group_members [ 597.581923] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 947da35d-3735-4215-9a1e-de72e321eb87 with Priority: HIGHEST for action port [ 597.583367] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd87052e-7745-4df2-93d7-5efc42c58438 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.583480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.583543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.583797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.583879] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd87052e-7745-4df2-93d7-5efc42c58438',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.584770] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd87052e-7745-4df2-93d7-5efc42c58438 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.584900] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.585333] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.585333] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.585333] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.585527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.586386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.586623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.586623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.586689] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd87052e-7745-4df2-93d7-5efc42c58438',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.588340] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-947da35d-3735-4215-9a1e-de72e321eb87 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.588340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-947da35d-3735-4215-9a1e-de72e321eb87" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.588340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-947da35d-3735-4215-9a1e-de72e321eb87" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.588534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-947da35d-3735-4215-9a1e-de72e321eb87" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.589086] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('947da35d-3735-4215-9a1e-de72e321eb87',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.093340] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fd87052e-7745-4df2-93d7-5efc42c58438',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.093340] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd87052e-7745-4df2-93d7-5efc42c58438 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.093340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.093340] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 947da35d-3735-4215-9a1e-de72e321eb87 with status ACTIVE [ 598.093340] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.093340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.093770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.094249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.094399] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.095281] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.095281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.095281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.095281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.095281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.095625] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.095674] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.096214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.096214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.096214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.096214] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 947da35d-3735-4215-9a1e-de72e321eb87 is going to be updated. [ 598.122542] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.122542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.122542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.122542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.122542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.122822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-947da35d-3735-4215-9a1e-de72e321eb87" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.241071] env[65413]: INFO networking_nsxv3.common.synchronization [req-e3b0d44e-a5b9-4db4-a37f-84112f4079a3 req-12c20977-0863-4cb3-a601-3759f5bd3a4c tempest-ImagesOneServerTestJSON-971250030 tempest-ImagesOneServerTestJSON-971250030-project-member] Enqueued Resource ID: 58542666-ecc3-4c4c-bed5-143746872487 with Priority: HIGHEST for action security_group_members [ 598.241071] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58542666-ecc3-4c4c-bed5-143746872487 with Priority: HIGHEST for action security_group_members [ 598.241071] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58542666-ecc3-4c4c-bed5-143746872487 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.241071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.241071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.241071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.241071] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.241071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.241071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.241385] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.241385] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.241385] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58542666-ecc3-4c4c-bed5-143746872487',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.579489] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-852 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.579489] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-852" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.579662] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-852" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.579933] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-852" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.580229] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.580395] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.580505] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.580719] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.580872] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.584026] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.584026] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.584026] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.584026] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.584026] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.584026] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.584026] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.600372] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fd87052e-7745-4df2-93d7-5efc42c58438',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.601303] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.601395] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 598.601494] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.601681] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-852" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.602224] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-3b8aae7e-3669-4d8c-9f9b-80213182e76f taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.602432] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-3b8aae7e-3669-4d8c-9f9b-80213182e76f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.602550] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-3b8aae7e-3669-4d8c-9f9b-80213182e76f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.602864] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-3b8aae7e-3669-4d8c-9f9b-80213182e76f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.602994] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b8aae7e-3669-4d8c-9f9b-80213182e76f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.743930] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.744077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.744125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.744515] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.744515] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.744665] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.744732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.744816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.745258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.745258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.745258] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58542666-ecc3-4c4c-bed5-143746872487 already deleted. [ 598.745258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.853718] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 in Status: SUCCESS [ 598.853718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.853906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.854182] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.854378] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.854536] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.854583] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.854730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.854811] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.854894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.854982] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cf0b2b30-620f-460d-be6e-f4b8fb0907c6',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.030373] env[65413]: INFO networking_nsxv3.common.synchronization [None req-bc994b2d-033e-4668-8fe1-a1f8fa747a8e None None] Enqueued Resource ID: b40b101d-48dd-4984-b069-fc6f15e3db24 with Priority: HIGHEST for action port [ 599.030579] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b40b101d-48dd-4984-b069-fc6f15e3db24 with Priority: HIGHEST for action port [ 599.031517] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-b40b101d-48dd-4984-b069-fc6f15e3db24 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.031644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b40b101d-48dd-4984-b069-fc6f15e3db24" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.031740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b40b101d-48dd-4984-b069-fc6f15e3db24" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.031981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b40b101d-48dd-4984-b069-fc6f15e3db24" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.032076] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b40b101d-48dd-4984-b069-fc6f15e3db24',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.105071] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.105071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.105071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.105522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.105522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.105522] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd87052e-7745-4df2-93d7-5efc42c58438 is going to be created. [ 599.107864] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.107864] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.107864] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.107864] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.107864] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.107864] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 3b8aae7e-3669-4d8c-9f9b-80213182e76f not found, creating... [ 599.108193] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.108339] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.108465] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.108787] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.108922] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.109230] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.109379] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.109487] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.109710] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.109834] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.110012] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 3b8aae7e-3669-4d8c-9f9b-80213182e76f is going to be created. [ 599.132545] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.132853] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.133013] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.133341] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.133623] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.133887] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-3b8aae7e-3669-4d8c-9f9b-80213182e76f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.137013] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.137139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.137207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.137412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.137568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.147259] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd87052e-7745-4df2-93d7-5efc42c58438 in Status: UNINITIALIZED for 2s [ 599.357275] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.357573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.357752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.357983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.358271] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.358948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.358948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.358948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.359103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.359103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.359344] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.359519] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.359615] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.359887] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.360073] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.360217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.360311] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.360533] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.360677] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.360836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.360945] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cf0b2b30-620f-460d-be6e-f4b8fb0907c6',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.534926] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b40b101d-48dd-4984-b069-fc6f15e3db24 [ 599.535227] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.535365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.535435] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.535673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.535763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.535856] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b40b101d-48dd-4984-b069-fc6f15e3db24 already deleted. [ 599.535934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b40b101d-48dd-4984-b069-fc6f15e3db24" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.864033] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cf0b2b30-620f-460d-be6e-f4b8fb0907c6: rpc.has_security_group_logging(os_id): False [ 599.885219] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.885390] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.885434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.885699] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.886528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.886871] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.886967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.887023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.887181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.887261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.887471] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.887571] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.887633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.887874] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.887960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.888158] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.888257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.888326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.888537] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.888623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.888739] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 is going to be created. [ 599.925897] env[65413]: INFO networking_nsxv3.common.synchronization [req-e3b0d44e-a5b9-4db4-a37f-84112f4079a3 req-1741cc2a-6ee1-430d-ba41-f9e0389672ed service nova] Enqueued Resource ID: 58542666-ecc3-4c4c-bed5-143746872487 with Priority: HIGHEST for action security_group_rules [ 599.926103] env[65413]: INFO networking_nsxv3.common.synchronization [req-e3b0d44e-a5b9-4db4-a37f-84112f4079a3 req-1741cc2a-6ee1-430d-ba41-f9e0389672ed service nova] Enqueued Resource ID: 58542666-ecc3-4c4c-bed5-143746872487 with Priority: HIGHEST for action security_group_members [ 599.926280] env[65413]: INFO networking_nsxv3.common.synchronization [req-e3b0d44e-a5b9-4db4-a37f-84112f4079a3 req-1741cc2a-6ee1-430d-ba41-f9e0389672ed service nova] Enqueued Resource ID: 3b8aae7e-3669-4d8c-9f9b-80213182e76f with Priority: HIGHEST for action port [ 599.926869] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58542666-ecc3-4c4c-bed5-143746872487 with Priority: HIGHEST for action security_group_rules [ 599.927022] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58542666-ecc3-4c4c-bed5-143746872487 with Priority: HIGHEST for action security_group_members [ 599.927153] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b8aae7e-3669-4d8c-9f9b-80213182e76f with Priority: HIGHEST for action port [ 599.927434] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58542666-ecc3-4c4c-bed5-143746872487 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.927563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.927639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.927945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.928051] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58542666-ecc3-4c4c-bed5-143746872487',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.929324] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58542666-ecc3-4c4c-bed5-143746872487 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.929633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.929633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.931032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.931215] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.931328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.931391] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.931574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.931661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.931755] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58542666-ecc3-4c4c-bed5-143746872487',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.936809] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b8aae7e-3669-4d8c-9f9b-80213182e76f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.937095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b8aae7e-3669-4d8c-9f9b-80213182e76f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.937205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b8aae7e-3669-4d8c-9f9b-80213182e76f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.937456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b8aae7e-3669-4d8c-9f9b-80213182e76f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.937658] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b8aae7e-3669-4d8c-9f9b-80213182e76f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.962216] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.962393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.962445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.962633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.962812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.980540] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 in Status: IN_PROGRESS for 2s [ 600.437371] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58542666-ecc3-4c4c-bed5-143746872487',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.440390] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58542666-ecc3-4c4c-bed5-143746872487 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.440515] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.440689] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b8aae7e-3669-4d8c-9f9b-80213182e76f with status ACTIVE [ 600.440855] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.440962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.441036] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.441252] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.441337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.441501] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.441781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.441781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.441781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.441868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.442043] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.442139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.442199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.442342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.442414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.442497] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b8aae7e-3669-4d8c-9f9b-80213182e76f is going to be updated. [ 600.468300] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.468462] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.468535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.468755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.468896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.469057] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b8aae7e-3669-4d8c-9f9b-80213182e76f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.603486] env[65413]: INFO networking_nsxv3.common.synchronization [req-2266b75e-6c7e-4ac3-b293-b89dafb2fe52 req-94d99fcb-666b-4082-b51b-bc45844b7a88 tempest-ServersAdminTestJSON-1071948959 tempest-ServersAdminTestJSON-1071948959-project-member] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 600.604227] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 600.604541] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.604666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.604742] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.605097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.605288] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.605408] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.605467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.605636] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.605722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.605814] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.942053] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58542666-ecc3-4c4c-bed5-143746872487',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.045466] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-743 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.045703] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.045819] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.046107] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.046352] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.046529] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.046640] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.046870] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.047057] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.047248] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.047360] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.047508] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.047565] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.047687] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.047748] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.047855] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.070256] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.070256] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.070383] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.070566] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.070900] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-dfe2fddb-5137-4eeb-b100-bd1bd5e413f6 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.071088] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-dfe2fddb-5137-4eeb-b100-bd1bd5e413f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.071537] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-dfe2fddb-5137-4eeb-b100-bd1bd5e413f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.071603] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-dfe2fddb-5137-4eeb-b100-bd1bd5e413f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.071701] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfe2fddb-5137-4eeb-b100-bd1bd5e413f6',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.108145] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.108291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.108368] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.108709] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.108839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.109096] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.109248] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.109322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.109570] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.109670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.109791] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e already deleted. [ 601.109878] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.159831] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd87052e-7745-4df2-93d7-5efc42c58438 in Status: SUCCESS [ 601.159831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.159831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.159831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.159831] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.159831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.159831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.159831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.159831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.159831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.159831] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fd87052e-7745-4df2-93d7-5efc42c58438',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.444574] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.444952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.444952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.445043] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.445086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.445451] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58542666-ecc3-4c4c-bed5-143746872487 is going to be created. [ 601.478705] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.479114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.479331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.479672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.479951] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.496944] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58542666-ecc3-4c4c-bed5-143746872487 in Status: UNINITIALIZED for 2s [ 601.576767] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.577218] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.577548] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.577945] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.578221] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.578446] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port dfe2fddb-5137-4eeb-b100-bd1bd5e413f6 not found, creating... [ 601.578971] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.579281] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.579534] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.580246] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.580459] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.580922] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.582180] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.582415] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.583297] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.583526] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.583808] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: dfe2fddb-5137-4eeb-b100-bd1bd5e413f6 is going to be created. [ 601.604551] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.604769] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.604886] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.605182] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.605400] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.605608] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-dfe2fddb-5137-4eeb-b100-bd1bd5e413f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.661953] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd87052e-7745-4df2-93d7-5efc42c58438 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.662140] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.662204] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.662441] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.662873] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.662873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.662873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.663059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.663107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.663174] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.663322] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd87052e-7745-4df2-93d7-5efc42c58438 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.663414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.663475] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.663627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.663759] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.663848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.663906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.664057] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.664132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.664215] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.664304] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fd87052e-7745-4df2-93d7-5efc42c58438',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.995245] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 in Status: SUCCESS [ 601.995245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.167714] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fd87052e-7745-4df2-93d7-5efc42c58438: rpc.has_security_group_logging(os_id): False [ 602.189016] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.189016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.189016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.189016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.189016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.189016] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.189016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.189016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.189016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.189016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.189016] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.189016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.189016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.189016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.189016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.189989] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.189989] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.189989] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.189989] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.189989] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.190152] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd87052e-7745-4df2-93d7-5efc42c58438 is going to be created. [ 602.249862] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.249862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.249862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.249862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.249862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.261448] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd87052e-7745-4df2-93d7-5efc42c58438 in Status: IN_PROGRESS for 2s [ 602.312673] env[65413]: INFO networking_nsxv3.common.synchronization [req-2266b75e-6c7e-4ac3-b293-b89dafb2fe52 req-1e8f17c9-f5e9-4a76-aa2a-ff49cd602e1d service nova] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_rules [ 602.312891] env[65413]: INFO networking_nsxv3.common.synchronization [req-2266b75e-6c7e-4ac3-b293-b89dafb2fe52 req-1e8f17c9-f5e9-4a76-aa2a-ff49cd602e1d service nova] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 602.313044] env[65413]: INFO networking_nsxv3.common.synchronization [req-2266b75e-6c7e-4ac3-b293-b89dafb2fe52 req-1e8f17c9-f5e9-4a76-aa2a-ff49cd602e1d service nova] Enqueued Resource ID: dfe2fddb-5137-4eeb-b100-bd1bd5e413f6 with Priority: HIGHEST for action port [ 602.313853] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_rules [ 602.313989] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 602.314098] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfe2fddb-5137-4eeb-b100-bd1bd5e413f6 with Priority: HIGHEST for action port [ 602.314373] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.314517] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.314616] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.314820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.314910] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.315800] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.315921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.315987] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.316194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.316350] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.316513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.316584] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.316695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.316777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.316872] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.318168] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfe2fddb-5137-4eeb-b100-bd1bd5e413f6 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.318310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfe2fddb-5137-4eeb-b100-bd1bd5e413f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.318412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfe2fddb-5137-4eeb-b100-bd1bd5e413f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.318562] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfe2fddb-5137-4eeb-b100-bd1bd5e413f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.318661] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfe2fddb-5137-4eeb-b100-bd1bd5e413f6',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.821080] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.822482] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.822644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.823374] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dfe2fddb-5137-4eeb-b100-bd1bd5e413f6 with status ACTIVE [ 602.823374] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.823566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.823566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.823933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.824201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.824391] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.824481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.824481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.824709] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.824829] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.825645] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.825645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.825645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.825645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.825645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.825645] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dfe2fddb-5137-4eeb-b100-bd1bd5e413f6 is going to be updated. [ 602.851700] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.851700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.851700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.851700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.851700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.851700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfe2fddb-5137-4eeb-b100-bd1bd5e413f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.324650] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.509615] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58542666-ecc3-4c4c-bed5-143746872487 in Status: SUCCESS [ 603.510185] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.510430] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.511367] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.511942] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.512167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.512301] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.512864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.513051] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.513114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.513216] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58542666-ecc3-4c4c-bed5-143746872487',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.574967] env[65413]: INFO networking_nsxv3.common.synchronization [req-5fd05afd-f14f-43ca-9356-7860c19fa862 req-86cbf6aa-ba8f-4864-b73b-60859a4e8120 tempest-ServerRescueTestJSON-745679716 tempest-ServerRescueTestJSON-745679716-project-member] Enqueued Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_members [ 603.574967] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_members [ 603.575284] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42ae76b-69ae-499f-b565-4ede857c249b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.575720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.575720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.575910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.576203] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.576357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.576964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.576964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.576964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.577129] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.826681] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.826936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.826936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.827127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.827219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.827320] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be created. [ 603.853900] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.854110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.854185] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.854461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.854622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.865622] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: UNINITIALIZED for 2s [ 604.015607] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58542666-ecc3-4c4c-bed5-143746872487 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.015790] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.015863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.016135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.016330] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.016535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.016610] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.016881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.017015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.017119] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.017301] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58542666-ecc3-4c4c-bed5-143746872487 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.017409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.017477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.017629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.017786] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.017893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.017974] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.018132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.018468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.018468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.018468] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58542666-ecc3-4c4c-bed5-143746872487',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.065042] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.065042] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-670" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.065042] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-670" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.065406] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-670" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.065637] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.065783] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.065880] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.066107] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.066242] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.066509] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.066621] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.066713] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.066821] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.066895] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.067019] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.067188] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.081267] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.081453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.081529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.081768] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.081926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.082102] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.082256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.082377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.082573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.082683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.082754] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c42ae76b-69ae-499f-b565-4ede857c249b already deleted. [ 604.082840] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.088350] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.088441] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 604.088679] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.088900] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-670" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.089300] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-fc16952e-4b63-41f9-bec3-b73ac6d737a3 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.090083] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-fc16952e-4b63-41f9-bec3-b73ac6d737a3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.090171] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-fc16952e-4b63-41f9-bec3-b73ac6d737a3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.090472] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-fc16952e-4b63-41f9-bec3-b73ac6d737a3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.090635] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc16952e-4b63-41f9-bec3-b73ac6d737a3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.169426] env[65413]: INFO networking_nsxv3.common.synchronization [req-40baf792-d76e-47ef-9572-6f49e470d2fc req-b28ba149-d571-422c-a392-efe15bc9f1d9 tempest-DeleteServersAdminTestJSON-761438827 tempest-DeleteServersAdminTestJSON-761438827-project-admin] Enqueued Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_members [ 604.170466] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_members [ 604.170956] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d03374-02a8-4013-ba8d-fa57c3795178 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.171135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.171243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.171638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.171872] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.172108] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.172201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.172644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.172644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.172644] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.277964] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fd87052e-7745-4df2-93d7-5efc42c58438 in Status: SUCCESS [ 604.278251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.521049] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58542666-ecc3-4c4c-bed5-143746872487: rpc.has_security_group_logging(os_id): False [ 604.540534] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.540725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.540809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.541055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.541152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.541382] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.541491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.541553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.541705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.541778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.541949] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.542054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.542109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.542246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.542317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.542489] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.542598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.542697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.542853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.542927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.543016] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58542666-ecc3-4c4c-bed5-143746872487 is going to be created. [ 604.594319] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.595101] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.595101] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.595319] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.595389] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.595596] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port fc16952e-4b63-41f9-bec3-b73ac6d737a3 not found, creating... [ 604.595942] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.596184] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.596359] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.596641] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.596833] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.597205] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.597437] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.597612] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.597879] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.598076] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.598280] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: fc16952e-4b63-41f9-bec3-b73ac6d737a3 is going to be created. [ 604.671507] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.672062] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.672062] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.672190] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.672349] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.672554] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-fc16952e-4b63-41f9-bec3-b73ac6d737a3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.676419] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.676419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.676419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.676419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.676419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.676419] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.676419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.676419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.676764] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.676764] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.676764] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d03374-02a8-4013-ba8d-fa57c3795178 is going to be updated. [ 604.687861] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.688104] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.688671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.688671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.688671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.703472] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58542666-ecc3-4c4c-bed5-143746872487 in Status: IN_PROGRESS for 2s [ 604.714727] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.714727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.714727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.714727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.714727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.728390] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d03374-02a8-4013-ba8d-fa57c3795178 in Status: IN_PROGRESS for 2s [ 605.332795] env[65413]: INFO networking_nsxv3.common.synchronization [req-5fd05afd-f14f-43ca-9356-7860c19fa862 req-a4e3532d-3431-4710-bdc2-25fd511891f1 service nova] Enqueued Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_rules [ 605.332795] env[65413]: INFO networking_nsxv3.common.synchronization [req-5fd05afd-f14f-43ca-9356-7860c19fa862 req-a4e3532d-3431-4710-bdc2-25fd511891f1 service nova] Enqueued Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_members [ 605.332795] env[65413]: INFO networking_nsxv3.common.synchronization [req-5fd05afd-f14f-43ca-9356-7860c19fa862 req-a4e3532d-3431-4710-bdc2-25fd511891f1 service nova] Enqueued Resource ID: fc16952e-4b63-41f9-bec3-b73ac6d737a3 with Priority: HIGHEST for action port [ 605.333569] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_rules [ 605.333746] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_members [ 605.333833] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc16952e-4b63-41f9-bec3-b73ac6d737a3 with Priority: HIGHEST for action port [ 605.339897] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c42ae76b-69ae-499f-b565-4ede857c249b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.339897] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.339897] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.339897] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.339897] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.340272] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42ae76b-69ae-499f-b565-4ede857c249b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.340272] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.340351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.343441] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.343441] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.343441] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.343441] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.343441] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.343441] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.343441] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.345030] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc16952e-4b63-41f9-bec3-b73ac6d737a3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.345030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc16952e-4b63-41f9-bec3-b73ac6d737a3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.345030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc16952e-4b63-41f9-bec3-b73ac6d737a3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.345030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc16952e-4b63-41f9-bec3-b73ac6d737a3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.345030] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc16952e-4b63-41f9-bec3-b73ac6d737a3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.620589] env[65413]: INFO networking_nsxv3.common.synchronization [None req-42f4935a-0b63-4620-95fa-91b11b43b5e5 None None] Enqueued Resource ID: a4429424-0dd7-4ecd-867a-a3d9aa69a2e2 with Priority: HIGHEST for action port [ 605.622226] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4429424-0dd7-4ecd-867a-a3d9aa69a2e2 with Priority: HIGHEST for action port [ 605.623088] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-a4429424-0dd7-4ecd-867a-a3d9aa69a2e2 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.623850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a4429424-0dd7-4ecd-867a-a3d9aa69a2e2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.623982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a4429424-0dd7-4ecd-867a-a3d9aa69a2e2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.624837] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a4429424-0dd7-4ecd-867a-a3d9aa69a2e2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.625498] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a4429424-0dd7-4ecd-867a-a3d9aa69a2e2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.841393] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42ae76b-69ae-499f-b565-4ede857c249b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.841393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.847459] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.848418] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc16952e-4b63-41f9-bec3-b73ac6d737a3 with status ACTIVE [ 605.848694] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.848828] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.848904] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.849180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.849277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.849454] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.851187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.851187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.851187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.851187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.851187] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.851187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.851187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.851187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.851187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.851187] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc16952e-4b63-41f9-bec3-b73ac6d737a3 is going to be updated. [ 605.876255] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 605.876653] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.877117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.877344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.877536] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.877701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.877780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.877933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.878068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.878172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.878271] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.880060] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.880060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.880278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.880278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.880488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.880555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc16952e-4b63-41f9-bec3-b73ac6d737a3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.113283] env[65413]: INFO networking_nsxv3.common.synchronization [req-a0673884-625a-45f6-9509-805caf5bb19a req-ed9f4643-0cc1-439c-ab8d-f76da9a4df1b tempest-MultipleCreateTestJSON-1512040954 tempest-MultipleCreateTestJSON-1512040954-project-member] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 606.113283] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 606.113283] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.113283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.113283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.113506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.113598] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.113722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.113809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.114026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.114115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.114208] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.128839] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a4429424-0dd7-4ecd-867a-a3d9aa69a2e2 [ 606.129081] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.129214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.129284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.129500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.129734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.129734] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a4429424-0dd7-4ecd-867a-a3d9aa69a2e2 already deleted. [ 606.130080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a4429424-0dd7-4ecd-867a-a3d9aa69a2e2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.353913] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.382281] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.382433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.382493] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.382722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.382910] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.383021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.383095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.384614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.384614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.384614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.384614] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.384614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.384614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.384614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.384614] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.384614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.384614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.384614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.384614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.384614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.384614] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.620534] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.620534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.620534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.620534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.620534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.620534] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.620534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.620534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.620534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.620534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.620534] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 already deleted. [ 606.620534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.716431] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58542666-ecc3-4c4c-bed5-143746872487 in Status: SUCCESS [ 606.717176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.737884] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d03374-02a8-4013-ba8d-fa57c3795178 in Status: SUCCESS [ 606.738114] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d03374-02a8-4013-ba8d-fa57c3795178 deletion is rescheduled due to dependency. [ 606.738228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.856953] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.857138] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.857214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.857503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.857599] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.857691] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c42ae76b-69ae-499f-b565-4ede857c249b is going to be created. [ 606.875050] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.875322] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.875466] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.875941] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.876247] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.876557] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.876672] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.876874] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.877021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.877232] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 606.877320] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 606.877419] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 606.877518] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 606.877616] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 606.877713] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 606.877843] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 606.884621] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.884786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.884851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.884998] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.885161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.886556] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69363ac6-cdf1-4edb-9d06-998638037b3e: rpc.has_security_group_logging(os_id): False [ 606.899489] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c42ae76b-69ae-499f-b565-4ede857c249b in Status: UNINITIALIZED for 2s [ 606.900430] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 606.900594] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 606.900717] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 606.900883] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.901225] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-b2fe63b3-a313-4e80-9680-33493b95aff4 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.901417] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-b2fe63b3-a313-4e80-9680-33493b95aff4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.901529] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-b2fe63b3-a313-4e80-9680-33493b95aff4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.901868] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-b2fe63b3-a313-4e80-9680-33493b95aff4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.901991] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2fe63b3-a313-4e80-9680-33493b95aff4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.914269] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.914555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.914630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.914849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.914939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.915198] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.915296] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.915364] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.915508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.915581] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.915763] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.915880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.915918] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.916401] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.916546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.916772] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.916863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.916927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.917068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.917228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.917322] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be created. [ 606.982565] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.982565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.982565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.982826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.982950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.998778] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: IN_PROGRESS for 2s [ 607.405316] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.405743] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.405743] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.405971] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.406062] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.406215] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port b2fe63b3-a313-4e80-9680-33493b95aff4 not found, creating... [ 607.406552] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.406840] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.407227] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.407520] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.407651] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.407980] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.410296] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.410427] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.411031] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.411031] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.411031] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: b2fe63b3-a313-4e80-9680-33493b95aff4 is going to be created. [ 607.442942] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.443186] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.443287] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.443564] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.443784] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.444021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-b2fe63b3-a313-4e80-9680-33493b95aff4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.471991] env[65413]: INFO networking_nsxv3.common.synchronization [None req-9309e29e-2d2d-4373-ac13-9b8c0059f9d5 None None] Enqueued Resource ID: 5ada8ca3-4f38-4d0c-8e5c-b68dea5a4623 with Priority: HIGHEST for action port [ 607.472565] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ada8ca3-4f38-4d0c-8e5c-b68dea5a4623 with Priority: HIGHEST for action port [ 607.472876] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ada8ca3-4f38-4d0c-8e5c-b68dea5a4623 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.473018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ada8ca3-4f38-4d0c-8e5c-b68dea5a4623" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.473074] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ada8ca3-4f38-4d0c-8e5c-b68dea5a4623" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.473343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ada8ca3-4f38-4d0c-8e5c-b68dea5a4623" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.473432] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ada8ca3-4f38-4d0c-8e5c-b68dea5a4623',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.944033] env[65413]: INFO networking_nsxv3.common.synchronization [None req-1ec33ef0-359f-499d-b8e6-ccf7c6131a89 tempest-ServersWithSpecificFlavorTestJSON-163220255 tempest-ServersWithSpecificFlavorTestJSON-163220255-project-member] Enqueued Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_rules [ 607.945176] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_rules [ 607.945768] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.945941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.946199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.946485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.946593] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.975578] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5ada8ca3-4f38-4d0c-8e5c-b68dea5a4623 [ 607.976092] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.976888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.977537] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.977961] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.978288] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.979107] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5ada8ca3-4f38-4d0c-8e5c-b68dea5a4623 already deleted. [ 607.979107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ada8ca3-4f38-4d0c-8e5c-b68dea5a4623" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.184455] env[65413]: INFO networking_nsxv3.common.synchronization [req-a0673884-625a-45f6-9509-805caf5bb19a req-13a9580a-94f7-4757-814e-3f275153ac0f service nova] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_rules [ 608.184455] env[65413]: INFO networking_nsxv3.common.synchronization [req-a0673884-625a-45f6-9509-805caf5bb19a req-13a9580a-94f7-4757-814e-3f275153ac0f service nova] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 608.184455] env[65413]: INFO networking_nsxv3.common.synchronization [req-a0673884-625a-45f6-9509-805caf5bb19a req-13a9580a-94f7-4757-814e-3f275153ac0f service nova] Enqueued Resource ID: b2fe63b3-a313-4e80-9680-33493b95aff4 with Priority: HIGHEST for action port [ 608.184455] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_rules [ 608.184455] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 608.184455] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2fe63b3-a313-4e80-9680-33493b95aff4 with Priority: HIGHEST for action port [ 608.184455] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.184455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.184455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.186553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.187703] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.190018] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.190018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.190018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.190018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.193258] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.193258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.193258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.193258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.193258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.193258] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.194070] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2fe63b3-a313-4e80-9680-33493b95aff4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.194244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2fe63b3-a313-4e80-9680-33493b95aff4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.194309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2fe63b3-a313-4e80-9680-33493b95aff4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.194535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2fe63b3-a313-4e80-9680-33493b95aff4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.194652] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2fe63b3-a313-4e80-9680-33493b95aff4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.470188] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.470743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.470743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.470743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.470906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.470906] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 already deleted. [ 608.470983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.696193] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.698314] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.698314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.698314] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b2fe63b3-a313-4e80-9680-33493b95aff4 with status ACTIVE [ 608.698314] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.698314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.698314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.698712] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.698748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.698940] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.699728] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.699728] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.699728] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.699728] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.699728] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.700056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.700056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.700145] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.700315] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.700393] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b2fe63b3-a313-4e80-9680-33493b95aff4 is going to be updated. [ 608.727583] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.727930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.727930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.728277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.728370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.728727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2fe63b3-a313-4e80-9680-33493b95aff4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.764571] env[65413]: INFO networking_nsxv3.common.synchronization [None req-7f327bc9-18ed-43e7-9c4b-08ed75e2cca9 tempest-ServersWithSpecificFlavorTestJSON-163220255 tempest-ServersWithSpecificFlavorTestJSON-163220255-project-member] Enqueued Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_rules [ 608.765746] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_rules [ 608.766854] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.767083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.767162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.767430] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.767536] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.912748] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c42ae76b-69ae-499f-b565-4ede857c249b in Status: SUCCESS [ 608.912995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.913272] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.913508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.913727] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.913944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.913944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.914127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.914513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.914513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.914513] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.012888] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 609.013516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.197516] env[65413]: INFO networking_nsxv3.common.synchronization [req-a0673884-625a-45f6-9509-805caf5bb19a req-639c33c6-11ed-4d58-8200-065e20d86f9e tempest-MultipleCreateTestJSON-1512040954 tempest-MultipleCreateTestJSON-1512040954-project-member] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 609.198038] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 609.198348] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.198452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.203417] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.288844] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.289054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.289054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.289931] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.289931] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.289931] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 already deleted. [ 609.289931] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.353416] env[65413]: INFO networking_nsxv3.common.synchronization [None req-8233898a-db91-423a-98f7-fd1ddc0f82ce None None] Enqueued Resource ID: 4b4295cb-6938-4e5c-8219-da67848106d4 with Priority: HIGHEST for action port [ 609.353969] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b4295cb-6938-4e5c-8219-da67848106d4 with Priority: HIGHEST for action port [ 609.354246] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b4295cb-6938-4e5c-8219-da67848106d4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.354369] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b4295cb-6938-4e5c-8219-da67848106d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.354436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b4295cb-6938-4e5c-8219-da67848106d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.354691] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b4295cb-6938-4e5c-8219-da67848106d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.354778] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b4295cb-6938-4e5c-8219-da67848106d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.417179] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42ae76b-69ae-499f-b565-4ede857c249b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.417428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.417428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.417836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.418029] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.418209] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.418282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.418447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.418525] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.418936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.419200] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42ae76b-69ae-499f-b565-4ede857c249b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.419317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.419378] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.419532] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.419749] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.419848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.419905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.420064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.420142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.420224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.420308] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.707785] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.707785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.707785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.707785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.707785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.707785] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be created. [ 609.736870] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.736870] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.737065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.737181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.737340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.749699] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: UNINITIALIZED for 2s [ 609.859389] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b4295cb-6938-4e5c-8219-da67848106d4 [ 609.859389] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.859389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.859389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.859389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.859389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.859389] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b4295cb-6938-4e5c-8219-da67848106d4 already deleted. [ 609.859389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b4295cb-6938-4e5c-8219-da67848106d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.922646] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c42ae76b-69ae-499f-b565-4ede857c249b: rpc.has_security_group_logging(os_id): False [ 609.942799] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.942955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.943034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.943262] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.943350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.943589] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.943706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.943770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.943920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.943999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.944185] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.944277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.944336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.944473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.944544] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.944714] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.944806] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.944864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.945014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.945187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.945277] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c42ae76b-69ae-499f-b565-4ede857c249b is going to be created. [ 610.012952] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.013131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.013201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.013427] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.013605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.029061] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c42ae76b-69ae-499f-b565-4ede857c249b in Status: IN_PROGRESS for 2s [ 610.346805] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.347027] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.347137] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.347399] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.347654] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.347804] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.347976] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.348300] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.348863] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.348863] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.349084] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 610.349084] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 610.349306] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 610.349306] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 610.349442] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 610.349528] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 610.379340] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 610.379582] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 610.379685] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 610.379800] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.380128] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-d49b6d16-5110-48a6-8b0f-78de2c0a3363 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.380300] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-d49b6d16-5110-48a6-8b0f-78de2c0a3363" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.380414] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-d49b6d16-5110-48a6-8b0f-78de2c0a3363" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.380764] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-d49b6d16-5110-48a6-8b0f-78de2c0a3363" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.380973] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d49b6d16-5110-48a6-8b0f-78de2c0a3363',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.884363] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.884698] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.884769] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.885115] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.886781] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.886781] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port d49b6d16-5110-48a6-8b0f-78de2c0a3363 not found, creating... [ 610.886781] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.887104] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.887104] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.887255] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.887514] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.887807] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.887948] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.888067] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.888277] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.888669] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.888829] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: d49b6d16-5110-48a6-8b0f-78de2c0a3363 is going to be created. [ 610.909715] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.909854] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.909896] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.910297] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.910374] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.910595] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-d49b6d16-5110-48a6-8b0f-78de2c0a3363" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.117331] env[65413]: INFO networking_nsxv3.common.synchronization [req-8d2d65d0-87ed-43c5-a596-09e39550e956 req-faa5d713-5d8c-4f2c-951b-47213fde76bf tempest-ServersAdminTestJSON-1071948959 tempest-ServersAdminTestJSON-1071948959-project-member] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 611.117331] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 611.117331] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.117331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.117331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.117331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.117331] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.117331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.117331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.119469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.119469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.119469] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.336253] env[65413]: INFO networking_nsxv3.common.synchronization [None req-9e43ae4c-8da8-403f-a7ce-1e0d89356f57 None None] Enqueued Resource ID: 74e55639-39b7-4b02-bc5d-d4f650e92eb9 with Priority: HIGHEST for action port [ 611.336535] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74e55639-39b7-4b02-bc5d-d4f650e92eb9 with Priority: HIGHEST for action port [ 611.339303] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-74e55639-39b7-4b02-bc5d-d4f650e92eb9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.339303] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74e55639-39b7-4b02-bc5d-d4f650e92eb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.339303] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74e55639-39b7-4b02-bc5d-d4f650e92eb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.339303] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74e55639-39b7-4b02-bc5d-d4f650e92eb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.339658] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74e55639-39b7-4b02-bc5d-d4f650e92eb9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.621247] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.691021] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-743 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.691021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.691021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.691021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.691599] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.691953] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.692219] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.692555] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.694988] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.694988] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.694988] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.694988] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.694988] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.694988] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.694988] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.694988] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.705053] env[65413]: INFO networking_nsxv3.common.synchronization [req-a0673884-625a-45f6-9509-805caf5bb19a req-c1bdeac3-c1c0-4319-9db1-263a7cbda36a service nova] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_rules [ 611.705053] env[65413]: INFO networking_nsxv3.common.synchronization [req-a0673884-625a-45f6-9509-805caf5bb19a req-c1bdeac3-c1c0-4319-9db1-263a7cbda36a service nova] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 611.705053] env[65413]: INFO networking_nsxv3.common.synchronization [req-a0673884-625a-45f6-9509-805caf5bb19a req-c1bdeac3-c1c0-4319-9db1-263a7cbda36a service nova] Enqueued Resource ID: d49b6d16-5110-48a6-8b0f-78de2c0a3363 with Priority: HIGHEST for action port [ 611.705053] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_rules [ 611.705053] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 611.705053] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d49b6d16-5110-48a6-8b0f-78de2c0a3363 with Priority: HIGHEST for action port [ 611.705872] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.706195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.706661] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.706924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.708956] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-d49b6d16-5110-48a6-8b0f-78de2c0a3363 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.708956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d49b6d16-5110-48a6-8b0f-78de2c0a3363" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.708956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d49b6d16-5110-48a6-8b0f-78de2c0a3363" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.708956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d49b6d16-5110-48a6-8b0f-78de2c0a3363" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.708956] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d49b6d16-5110-48a6-8b0f-78de2c0a3363',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.713913] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.716136] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.716136] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.716136] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.716136] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-22cdf97a-ca5f-4346-80b6-be94bede3d2e taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.716136] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-22cdf97a-ca5f-4346-80b6-be94bede3d2e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.716136] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-22cdf97a-ca5f-4346-80b6-be94bede3d2e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.716136] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-22cdf97a-ca5f-4346-80b6-be94bede3d2e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.716136] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22cdf97a-ca5f-4346-80b6-be94bede3d2e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.760266] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: SUCCESS [ 611.760516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.760642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.760866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.761140] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.761290] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.761290] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.761688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.761688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.761688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.761688] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.762591] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.762790] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.762948] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.763148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.763148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.763310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.763429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.763486] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.843592] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74e55639-39b7-4b02-bc5d-d4f650e92eb9 [ 611.843851] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.843991] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.844087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.844333] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.845487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.845487] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74e55639-39b7-4b02-bc5d-d4f650e92eb9 already deleted. [ 611.845487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74e55639-39b7-4b02-bc5d-d4f650e92eb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.042990] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c42ae76b-69ae-499f-b565-4ede857c249b in Status: SUCCESS [ 612.043238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.124128] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.209958] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d49b6d16-5110-48a6-8b0f-78de2c0a3363 with status ACTIVE [ 612.210198] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.210337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.210426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.210657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.210748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.211020] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.211285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.211285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.211382] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.211382] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.212409] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.212409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.212409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.212409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.212409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.212409] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d49b6d16-5110-48a6-8b0f-78de2c0a3363 is going to be updated. [ 612.222593] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.222593] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.222593] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.222593] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.222593] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.222593] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 22cdf97a-ca5f-4346-80b6-be94bede3d2e not found, creating... [ 612.222593] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.222593] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.222593] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.222593] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.222593] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.223155] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.223155] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.223155] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.223155] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.223155] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.223155] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 22cdf97a-ca5f-4346-80b6-be94bede3d2e is going to be created. [ 612.239110] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.239344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.239398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.240142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.240501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.240575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d49b6d16-5110-48a6-8b0f-78de2c0a3363" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.245021] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.245249] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.245370] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.245629] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.245841] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.246242] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-22cdf97a-ca5f-4346-80b6-be94bede3d2e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.266109] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.266297] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.266410] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.627198] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.627421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.627421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.627753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.627993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.628083] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be updated. [ 612.667646] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.667646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.667646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.667646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.667646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.677408] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: IN_PROGRESS for 2s [ 612.768807] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.171114] env[65413]: INFO networking_nsxv3.common.synchronization [req-8d2d65d0-87ed-43c5-a596-09e39550e956 req-e2e66acc-c3f9-4e8c-abb3-3d306fd4d671 service nova] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_rules [ 613.171868] env[65413]: INFO networking_nsxv3.common.synchronization [req-8d2d65d0-87ed-43c5-a596-09e39550e956 req-e2e66acc-c3f9-4e8c-abb3-3d306fd4d671 service nova] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 613.171868] env[65413]: INFO networking_nsxv3.common.synchronization [req-8d2d65d0-87ed-43c5-a596-09e39550e956 req-e2e66acc-c3f9-4e8c-abb3-3d306fd4d671 service nova] Enqueued Resource ID: 22cdf97a-ca5f-4346-80b6-be94bede3d2e with Priority: HIGHEST for action port [ 613.171868] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_rules [ 613.171868] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 613.171868] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 22cdf97a-ca5f-4346-80b6-be94bede3d2e with Priority: HIGHEST for action port [ 613.172626] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.172758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.172758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.172964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.173091] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.174448] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.174709] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.174869] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-22cdf97a-ca5f-4346-80b6-be94bede3d2e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.174984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-22cdf97a-ca5f-4346-80b6-be94bede3d2e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.175055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-22cdf97a-ca5f-4346-80b6-be94bede3d2e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.175249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-22cdf97a-ca5f-4346-80b6-be94bede3d2e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.175325] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('22cdf97a-ca5f-4346-80b6-be94bede3d2e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.272900] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.272900] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.272900] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.273161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.273161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.273311] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be updated. [ 613.302222] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.302411] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.302457] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.302678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.302784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.316680] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: IN_PROGRESS for 2s [ 613.675888] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.676182] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.677388] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 22cdf97a-ca5f-4346-80b6-be94bede3d2e with status ACTIVE [ 613.677575] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.677721] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.677789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.678026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.678116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.678288] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.678405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.678484] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.678716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.679014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.679211] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.679307] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.679423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.679538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.679595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.679670] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 22cdf97a-ca5f-4346-80b6-be94bede3d2e is going to be updated. [ 613.703178] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.703409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.703454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.703678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.703817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.703970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-22cdf97a-ca5f-4346-80b6-be94bede3d2e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.841463] env[65413]: INFO networking_nsxv3.common.synchronization [req-40601daf-af40-4625-9a57-55cea87d2dfa req-18396612-ed0d-433c-93e1-e1aff6d22e5b tempest-ServerActionsTestJSON-1087044681 tempest-ServerActionsTestJSON-1087044681-project-member] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 613.842255] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 613.842685] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.842879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.843139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.843335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.843569] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.843746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.843899] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.844140] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.844258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.844400] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.348530] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.348977] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.348977] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.349092] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.349128] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.349315] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.349493] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.349557] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.349777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.349858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.349956] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef already deleted. [ 614.350111] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.612707] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-56 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.614101] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.615026] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.615026] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.615026] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.615303] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.615420] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.615791] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.615791] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.616140] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.616270] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.616372] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.616471] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.616867] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.617181] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.617341] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.640800] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.641023] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.641184] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.641362] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.641717] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-0b6d946a-d398-4c1e-bf74-7df2518a23c3 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.641895] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-0b6d946a-d398-4c1e-bf74-7df2518a23c3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.641985] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-0b6d946a-d398-4c1e-bf74-7df2518a23c3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.642350] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-0b6d946a-d398-4c1e-bf74-7df2518a23c3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.642469] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b6d946a-d398-4c1e-bf74-7df2518a23c3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.687605] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 614.687900] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.688135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.688393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.688585] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.688880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.688930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.689127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.689285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.689324] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.037565] env[65413]: INFO networking_nsxv3.common.synchronization [None req-78f2862c-9f61-43de-8ad1-56389ae8d0b1 None None] Enqueued Resource ID: 9dc95a74-4b79-4d35-93c6-32050edb1fa3 with Priority: HIGHEST for action port [ 615.038040] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9dc95a74-4b79-4d35-93c6-32050edb1fa3 with Priority: HIGHEST for action port [ 615.038470] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-9dc95a74-4b79-4d35-93c6-32050edb1fa3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.038680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9dc95a74-4b79-4d35-93c6-32050edb1fa3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.038885] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9dc95a74-4b79-4d35-93c6-32050edb1fa3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.039326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9dc95a74-4b79-4d35-93c6-32050edb1fa3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.039447] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9dc95a74-4b79-4d35-93c6-32050edb1fa3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.145689] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.145950] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.146089] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.146406] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.146549] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.146708] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 0b6d946a-d398-4c1e-bf74-7df2518a23c3 not found, creating... [ 615.146988] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.147173] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.147288] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.147508] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.147668] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.147944] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.148183] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.148242] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.148414] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.148536] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.148707] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 0b6d946a-d398-4c1e-bf74-7df2518a23c3 is going to be created. [ 615.171549] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.172358] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.172495] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.172770] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.172999] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.173262] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-0b6d946a-d398-4c1e-bf74-7df2518a23c3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.191862] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.331726] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: SUCCESS [ 615.331940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.332767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.332767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.332936] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.333051] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.333119] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.333277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.333365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.333465] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.542387] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9dc95a74-4b79-4d35-93c6-32050edb1fa3 [ 615.542657] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.542771] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.542842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.543106] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.544315] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.544315] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9dc95a74-4b79-4d35-93c6-32050edb1fa3 already deleted. [ 615.544315] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9dc95a74-4b79-4d35-93c6-32050edb1fa3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.695587] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.835554] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.030648] env[65413]: INFO networking_nsxv3.common.synchronization [req-40601daf-af40-4625-9a57-55cea87d2dfa req-7f70090e-bf2e-4987-9825-db7d327400ff service nova] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_rules [ 616.030841] env[65413]: INFO networking_nsxv3.common.synchronization [req-40601daf-af40-4625-9a57-55cea87d2dfa req-7f70090e-bf2e-4987-9825-db7d327400ff service nova] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 616.031011] env[65413]: INFO networking_nsxv3.common.synchronization [req-40601daf-af40-4625-9a57-55cea87d2dfa req-7f70090e-bf2e-4987-9825-db7d327400ff service nova] Enqueued Resource ID: 0b6d946a-d398-4c1e-bf74-7df2518a23c3 with Priority: HIGHEST for action port [ 616.031738] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_rules [ 616.031919] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 616.032037] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b6d946a-d398-4c1e-bf74-7df2518a23c3 with Priority: HIGHEST for action port [ 616.032379] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.032624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.032691] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.032962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.033082] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.036210] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.036210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.036210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.036210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.036210] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.036210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.036210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.036210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.036210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.036210] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.037641] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b6d946a-d398-4c1e-bf74-7df2518a23c3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.037641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b6d946a-d398-4c1e-bf74-7df2518a23c3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.037641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b6d946a-d398-4c1e-bf74-7df2518a23c3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.037835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b6d946a-d398-4c1e-bf74-7df2518a23c3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.037835] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b6d946a-d398-4c1e-bf74-7df2518a23c3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.201532] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.201723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.201821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.202060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.202176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.202277] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be updated. [ 616.232300] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.232300] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.232300] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.232300] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.232300] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.244239] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: IN_PROGRESS for 2s [ 616.340712] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.539593] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.542091] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.542238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.542834] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b6d946a-d398-4c1e-bf74-7df2518a23c3 with status ACTIVE [ 616.543109] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.543168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.543201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.543458] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.543542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.544154] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.544154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.544154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.544154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.544345] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.544401] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.544504] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.544564] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.544735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.544798] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.544884] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b6d946a-d398-4c1e-bf74-7df2518a23c3 is going to be updated. [ 616.590071] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.590276] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.590276] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.590574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.590676] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.590840] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b6d946a-d398-4c1e-bf74-7df2518a23c3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.719247] env[65413]: INFO networking_nsxv3.common.synchronization [req-ba10665c-39c8-4355-b69f-ff1748dcc768 req-8d299148-fcab-4e3e-a3b8-3f93401f038c tempest-VolumesAssistedSnapshotsTest-1837750333 tempest-VolumesAssistedSnapshotsTest-1837750333-project-member] Enqueued Resource ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 with Priority: HIGHEST for action security_group_members [ 616.719941] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 with Priority: HIGHEST for action security_group_members [ 616.721396] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7541a263-2861-4b4d-ab51-2db5044fecf7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.721546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.721614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.721867] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.722047] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.722157] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.722216] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.722372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.722459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.722551] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7541a263-2861-4b4d-ab51-2db5044fecf7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.844747] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.844861] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.844861] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.845114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.845228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.845337] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be updated. [ 616.901906] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.901906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.901906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.901906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.901906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.914070] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: IN_PROGRESS for 2s [ 617.046315] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.224989] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.224989] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.224989] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.225483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.225483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.225583] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.225933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.225933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.225933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.226347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.226347] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 already deleted. [ 617.226347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.267230] env[65413]: INFO networking_nsxv3.common.synchronization [None req-bcd2ff32-d0ac-408f-8f48-84fa2527d178 None None] Enqueued Resource ID: 7b345f9b-b99b-4d76-8220-3eaac61c05ce with Priority: HIGHEST for action port [ 617.269851] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b345f9b-b99b-4d76-8220-3eaac61c05ce with Priority: HIGHEST for action port [ 617.270798] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-7b345f9b-b99b-4d76-8220-3eaac61c05ce taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.270999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7b345f9b-b99b-4d76-8220-3eaac61c05ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.271071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7b345f9b-b99b-4d76-8220-3eaac61c05ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.271443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7b345f9b-b99b-4d76-8220-3eaac61c05ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.271608] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7b345f9b-b99b-4d76-8220-3eaac61c05ce',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.277533] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-241 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.277533] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-241" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.277533] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-241" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.278344] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-241" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.278721] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.278968] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.279095] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.279336] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.279505] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.279751] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.279866] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.280035] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.280152] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.280257] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.280355] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.280483] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.323509] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.323509] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.042 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 617.323509] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.323509] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-241" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.323509] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-07c21d89-065a-4041-8247-43c2309f1060 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.323509] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-07c21d89-065a-4041-8247-43c2309f1060" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.323509] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-07c21d89-065a-4041-8247-43c2309f1060" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.323509] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-07c21d89-065a-4041-8247-43c2309f1060" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.324384] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07c21d89-065a-4041-8247-43c2309f1060',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.549535] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.550088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.550088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.550647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.550827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.551026] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef is going to be created. [ 617.579146] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.579624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.579624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.580014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.580146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.593673] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: UNINITIALIZED for 2s [ 617.785627] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7b345f9b-b99b-4d76-8220-3eaac61c05ce [ 617.785627] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.785627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.785627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.785627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.785627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.785627] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7b345f9b-b99b-4d76-8220-3eaac61c05ce already deleted. [ 617.785627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7b345f9b-b99b-4d76-8220-3eaac61c05ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.827343] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.830020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.830020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.830020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.830020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.830020] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 07c21d89-065a-4041-8247-43c2309f1060 not found, creating... [ 617.830020] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.830020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.830020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.830020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.830020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.830454] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.830454] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.831458] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.831861] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.832155] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.832442] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 07c21d89-065a-4041-8247-43c2309f1060 is going to be created. [ 617.855410] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.855410] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.855410] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.855410] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.855410] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.855410] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-07c21d89-065a-4041-8247-43c2309f1060" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.261630] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 618.261630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.261630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.261882] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.262342] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.262342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.262342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.262581] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.262618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.263614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.263614] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.575629] env[65413]: INFO networking_nsxv3.common.synchronization [req-ba10665c-39c8-4355-b69f-ff1748dcc768 req-40ac98ce-6fac-41e4-abda-e60496fc0af4 service nova] Enqueued Resource ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 with Priority: HIGHEST for action security_group_rules [ 618.575629] env[65413]: INFO networking_nsxv3.common.synchronization [req-ba10665c-39c8-4355-b69f-ff1748dcc768 req-40ac98ce-6fac-41e4-abda-e60496fc0af4 service nova] Enqueued Resource ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 with Priority: HIGHEST for action security_group_members [ 618.576884] env[65413]: INFO networking_nsxv3.common.synchronization [req-ba10665c-39c8-4355-b69f-ff1748dcc768 req-40ac98ce-6fac-41e4-abda-e60496fc0af4 service nova] Enqueued Resource ID: 07c21d89-065a-4041-8247-43c2309f1060 with Priority: HIGHEST for action port [ 618.577279] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 with Priority: HIGHEST for action security_group_rules [ 618.577590] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 with Priority: HIGHEST for action security_group_members [ 618.577590] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07c21d89-065a-4041-8247-43c2309f1060 with Priority: HIGHEST for action port [ 618.581874] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7541a263-2861-4b4d-ab51-2db5044fecf7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.581874] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.581874] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.581874] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.581874] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7541a263-2861-4b4d-ab51-2db5044fecf7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.582435] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7541a263-2861-4b4d-ab51-2db5044fecf7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.583096] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.583233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.583474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.583734] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.583952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.583952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.584112] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.584178] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.584262] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7541a263-2861-4b4d-ab51-2db5044fecf7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.585298] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-07c21d89-065a-4041-8247-43c2309f1060 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.585810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07c21d89-065a-4041-8247-43c2309f1060" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.585810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07c21d89-065a-4041-8247-43c2309f1060" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.585810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07c21d89-065a-4041-8247-43c2309f1060" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.585810] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07c21d89-065a-4041-8247-43c2309f1060',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.627163] env[65413]: INFO networking_nsxv3.common.synchronization [None req-6746d913-0621-4285-964b-8ab4607d6fde None None] Enqueued Resource ID: 05c6767f-3edc-4049-b2ee-0382c01a5222 with Priority: HIGHEST for action port [ 618.627800] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05c6767f-3edc-4049-b2ee-0382c01a5222 with Priority: HIGHEST for action port [ 618.630196] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-05c6767f-3edc-4049-b2ee-0382c01a5222 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.630608] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05c6767f-3edc-4049-b2ee-0382c01a5222" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.630721] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05c6767f-3edc-4049-b2ee-0382c01a5222" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.631415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05c6767f-3edc-4049-b2ee-0382c01a5222" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.631415] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05c6767f-3edc-4049-b2ee-0382c01a5222',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.771448] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.771448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.771448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.771448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.771448] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.771448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.771448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.771448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.771448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.771448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.771448] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.772470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.772470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.772470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.772470] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.772470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.772470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.772470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.772689] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.772689] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.772998] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.934914] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: SUCCESS [ 618.935215] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.936853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.936853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.936853] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.936853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.936853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.936853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.936853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.936853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.936853] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.936853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.936853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.936853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.937573] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.937573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.937573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.937573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.937573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.937573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.937573] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.091467] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7541a263-2861-4b4d-ab51-2db5044fecf7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.093512] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7541a263-2861-4b4d-ab51-2db5044fecf7 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.093672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.094015] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07c21d89-065a-4041-8247-43c2309f1060 with status ACTIVE [ 619.094188] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.094301] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.094365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.094663] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.094663] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.094881] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.094936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.094969] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.096864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.100274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.100274] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.100274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.100274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.100274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.100274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.100274] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07c21d89-065a-4041-8247-43c2309f1060 is going to be updated. [ 619.126070] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.126070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.126070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.126070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.126070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.126070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07c21d89-065a-4041-8247-43c2309f1060" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.133653] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05c6767f-3edc-4049-b2ee-0382c01a5222 [ 619.134096] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.134421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.134988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.135587] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.135866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.136515] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05c6767f-3edc-4049-b2ee-0382c01a5222 already deleted. [ 619.136515] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05c6767f-3edc-4049-b2ee-0382c01a5222" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.276582] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69363ac6-cdf1-4edb-9d06-998638037b3e: rpc.has_security_group_logging(os_id): False [ 619.296524] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.296713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.296760] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.297016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.297093] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.297254] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.297350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.297408] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.297559] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.297637] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.297823] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.297920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.298040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.298132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.298201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.298372] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.298465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.298552] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.298665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.298776] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.298846] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be updated. [ 619.384525] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.384740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.384836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.385197] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.385873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.405840] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: IN_PROGRESS for 2s [ 619.442704] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa7226ef-74d4-482f-ac1d-bbefed534583: rpc.has_security_group_logging(os_id): False [ 619.467026] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.467026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.467026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.467026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.467026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.467026] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.467026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.467026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.467026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.467026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.467026] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.467026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.467026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.467026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.467026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.467648] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.467648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.467648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.469020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.472639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.472639] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be created. [ 619.566667] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.567669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.567669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.567669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.567803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.584984] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: IN_PROGRESS for 2s [ 619.597511] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7541a263-2861-4b4d-ab51-2db5044fecf7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.604895] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: SUCCESS [ 619.605207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.605461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.606511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.606987] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.607154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.607214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.607427] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.607613] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.607926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.608089] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.099095] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.099095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.099400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.099679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.099778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.099910] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 is going to be created. [ 620.110999] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.127738] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.127900] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.127980] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.128228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.128386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.140250] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 in Status: UNINITIALIZED for 2s [ 620.616012] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d31c425c-609d-448d-bad8-0a938d0bf8ef: rpc.has_security_group_logging(os_id): False [ 620.639064] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.639522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.639522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.641073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.641073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.641225] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.643240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.643355] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.643583] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.643659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.643765] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef is going to be created. [ 620.752030] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.752030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.752030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.752030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.752030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.766020] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: IN_PROGRESS for 2s [ 621.420352] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 621.420591] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.607843] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: SUCCESS [ 621.607843] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.608063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.608181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.608243] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.756676] env[65413]: INFO networking_nsxv3.common.synchronization [None req-9f3dc783-b509-450b-bcdd-c531bdde6cc7 None None] Enqueued Resource ID: 2be8f2b1-3323-4916-ae8d-be3aa26db56d with Priority: HIGHEST for action port [ 621.757467] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2be8f2b1-3323-4916-ae8d-be3aa26db56d with Priority: HIGHEST for action port [ 621.757941] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-2be8f2b1-3323-4916-ae8d-be3aa26db56d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.758109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2be8f2b1-3323-4916-ae8d-be3aa26db56d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.758194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2be8f2b1-3323-4916-ae8d-be3aa26db56d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.758498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2be8f2b1-3323-4916-ae8d-be3aa26db56d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.758560] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2be8f2b1-3323-4916-ae8d-be3aa26db56d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.111832] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.111832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.111832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.111832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.111832] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.111832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.112148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.112148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.112148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.112236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.113123] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.168492] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 in Status: SUCCESS [ 622.168771] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.169337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.169337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.170073] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.170073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.170073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.170073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.170073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.170073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.170343] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7541a263-2861-4b4d-ab51-2db5044fecf7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.262804] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2be8f2b1-3323-4916-ae8d-be3aa26db56d [ 622.262804] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.262804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.262804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.262804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.262804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.262804] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2be8f2b1-3323-4916-ae8d-be3aa26db56d already deleted. [ 622.262804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2be8f2b1-3323-4916-ae8d-be3aa26db56d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.312342] env[65413]: INFO networking_nsxv3.common.synchronization [req-beb9dd50-d1f9-43ac-a4a2-3c0b6c1d337b req-577bcb15-7010-4e95-a455-fac2d97abe7f tempest-DeleteServersTestJSON-2008533967 tempest-DeleteServersTestJSON-2008533967-project-member] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 622.312991] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 622.313852] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.313960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.314020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.314489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.314791] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.314942] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.314979] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.315249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.315332] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.315428] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.616121] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.616456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.616540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.616889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.617140] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.617317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.617450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.617605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.617746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.617912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.618134] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.618327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.618417] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.618642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.618889] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.619017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.623313] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.623535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.623618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.623687] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.623794] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.673487] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7541a263-2861-4b4d-ab51-2db5044fecf7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.790042] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: SUCCESS [ 622.790042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.820719] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.820719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.820719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.820719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.820719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.820719] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.820719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.820719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.820719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.820719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.820719] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 already deleted. [ 622.820719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.926472] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-586 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.926759] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.926901] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.930520] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.930863] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.931078] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.931195] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.931473] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.931643] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.931876] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.931986] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 622.932136] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 622.932241] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 622.932359] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 622.932542] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 622.932612] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 622.964050] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 622.964241] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 622.964385] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 622.964594] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.965151] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-62e3346c-e2f8-451d-9ff6-3e8d6c35e14c taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.965520] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-62e3346c-e2f8-451d-9ff6-3e8d6c35e14c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.965618] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-62e3346c-e2f8-451d-9ff6-3e8d6c35e14c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.966974] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-62e3346c-e2f8-451d-9ff6-3e8d6c35e14c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.967310] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62e3346c-e2f8-451d-9ff6-3e8d6c35e14c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.126171] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa7226ef-74d4-482f-ac1d-bbefed534583: rpc.has_security_group_logging(os_id): False [ 623.154768] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.154983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.155857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.155857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.155857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.155857] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.156265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.156265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.156265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.156265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.156471] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.156636] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.156636] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.157018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.157018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.157423] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.157594] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.157720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.157894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.157965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.158102] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be updated. [ 623.178999] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7541a263-2861-4b4d-ab51-2db5044fecf7: rpc.has_security_group_logging(os_id): False [ 623.202117] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.202472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.202472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.202784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.202917] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.203302] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.203471] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.203573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.203821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.203950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.204082] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 is going to be created. [ 623.236299] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.236539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.236667] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.237089] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.237540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.254967] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: IN_PROGRESS for 2s [ 623.286715] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.286955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.287076] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.287406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.287762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.308835] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 in Status: IN_PROGRESS for 2s [ 623.470653] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.471030] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.471030] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.471267] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.472203] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.472203] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 62e3346c-e2f8-451d-9ff6-3e8d6c35e14c not found, creating... [ 623.472203] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.472203] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.473125] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.473125] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.473125] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.473521] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.473739] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.473927] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.474254] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.474409] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.474909] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 62e3346c-e2f8-451d-9ff6-3e8d6c35e14c is going to be created. [ 623.518340] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.518340] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.518340] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.518340] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.518340] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.518340] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-62e3346c-e2f8-451d-9ff6-3e8d6c35e14c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.323620] env[65413]: INFO networking_nsxv3.common.synchronization [req-beb9dd50-d1f9-43ac-a4a2-3c0b6c1d337b req-d9218543-ae3b-4379-9cb5-28ad347b9610 service nova] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_rules [ 624.324066] env[65413]: INFO networking_nsxv3.common.synchronization [req-beb9dd50-d1f9-43ac-a4a2-3c0b6c1d337b req-d9218543-ae3b-4379-9cb5-28ad347b9610 service nova] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 624.324066] env[65413]: INFO networking_nsxv3.common.synchronization [req-beb9dd50-d1f9-43ac-a4a2-3c0b6c1d337b req-d9218543-ae3b-4379-9cb5-28ad347b9610 service nova] Enqueued Resource ID: 62e3346c-e2f8-451d-9ff6-3e8d6c35e14c with Priority: HIGHEST for action port [ 624.324668] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_rules [ 624.326580] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 624.326580] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62e3346c-e2f8-451d-9ff6-3e8d6c35e14c with Priority: HIGHEST for action port [ 624.326580] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.326580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.326580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.326580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.326580] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.327505] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.328617] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.328617] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.328617] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.328617] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.328883] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.328883] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.330149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.330149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.330149] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.330149] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-62e3346c-e2f8-451d-9ff6-3e8d6c35e14c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.330646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62e3346c-e2f8-451d-9ff6-3e8d6c35e14c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.330646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62e3346c-e2f8-451d-9ff6-3e8d6c35e14c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.330646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62e3346c-e2f8-451d-9ff6-3e8d6c35e14c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.330646] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62e3346c-e2f8-451d-9ff6-3e8d6c35e14c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.648444] env[65413]: INFO networking_nsxv3.common.synchronization [None req-1ced5b8d-fbfd-4211-a787-2dfc3a3f54c1 None None] Enqueued Resource ID: 0ab38c72-3510-47c0-a3b3-5503586fed11 with Priority: HIGHEST for action port [ 624.650187] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ab38c72-3510-47c0-a3b3-5503586fed11 with Priority: HIGHEST for action port [ 624.650876] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ab38c72-3510-47c0-a3b3-5503586fed11 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.651141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ab38c72-3510-47c0-a3b3-5503586fed11" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.651273] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ab38c72-3510-47c0-a3b3-5503586fed11" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.652566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ab38c72-3510-47c0-a3b3-5503586fed11" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.652734] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ab38c72-3510-47c0-a3b3-5503586fed11',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.833325] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.835215] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.835215] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.835215] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62e3346c-e2f8-451d-9ff6-3e8d6c35e14c with status ACTIVE [ 624.835215] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.835437] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.835437] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.835622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.835664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.836039] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.836039] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.837188] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.837402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.837495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.837695] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.837795] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.837859] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.838033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.838143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.838293] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62e3346c-e2f8-451d-9ff6-3e8d6c35e14c is going to be updated. [ 624.870445] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.870704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.870742] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.871269] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.871269] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.871962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62e3346c-e2f8-451d-9ff6-3e8d6c35e14c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.156293] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ab38c72-3510-47c0-a3b3-5503586fed11 [ 625.156549] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.156724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.156787] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.157167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.157280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.157380] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ab38c72-3510-47c0-a3b3-5503586fed11 already deleted. [ 625.157485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ab38c72-3510-47c0-a3b3-5503586fed11" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.269532] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: SUCCESS [ 625.269854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.341133] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.357451] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 in Status: SUCCESS [ 625.357707] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.547085] env[65413]: INFO networking_nsxv3.common.synchronization [req-ffad4aac-852f-4f9d-a423-eeaf6c48c07d req-090497f7-a816-4e30-bec1-4c816ad062f3 tempest-ServerDiagnosticsNegativeTest-1665493519 tempest-ServerDiagnosticsNegativeTest-1665493519-project-member] Enqueued Resource ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 with Priority: HIGHEST for action security_group_members [ 625.547734] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 with Priority: HIGHEST for action security_group_members [ 625.548148] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.548329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.548404] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.548618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.548811] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.548915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.548978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.549151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.549238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.549334] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cf0b2b30-620f-460d-be6e-f4b8fb0907c6',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.849395] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.849395] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.849395] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.849395] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.849395] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.849395] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be created. [ 625.879443] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.879622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.879671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.879983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.880187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.899640] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: UNINITIALIZED for 2s [ 626.054801] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.054801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.054801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.054801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.054801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.054801] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.054801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.055892] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.055892] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.055892] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.055892] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 is going to be updated. [ 626.066412] env[65413]: INFO networking_nsxv3.common.synchronization [req-1c3d3a18-7a6e-41c7-b8a7-cabef966ae15 req-50a1e054-8098-44b5-bd77-f0312f2c1bd9 tempest-ServerDiagnosticsTest-346665145 tempest-ServerDiagnosticsTest-346665145-project-member] Enqueued Resource ID: 14ffed21-0b3b-46f2-aece-160a014b9767 with Priority: HIGHEST for action security_group_members [ 626.066412] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ffed21-0b3b-46f2-aece-160a014b9767 with Priority: HIGHEST for action security_group_members [ 626.066412] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ffed21-0b3b-46f2-aece-160a014b9767 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.066412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.066412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.069993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.070248] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.070397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.070459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.070835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.070835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.070981] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14ffed21-0b3b-46f2-aece-160a014b9767',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.106512] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.106512] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.106797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.107245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.107463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.129357] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 in Status: IN_PROGRESS for 2s [ 626.233027] env[65413]: INFO networking_nsxv3.common.synchronization [req-29063132-9baa-4825-b7d8-7dd5fcbc9424 req-3b42a569-0403-4510-be1e-0f0c09ea827a tempest-SecurityGroupRulesNegativeTestJSON-882774724 tempest-SecurityGroupRulesNegativeTestJSON-882774724-project-member] Enqueued Resource ID: 071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7 with Priority: HIGHEST for action security_group_rules [ 626.233027] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7 with Priority: HIGHEST for action security_group_rules [ 626.233027] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.233027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.233027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.233027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.233027] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.566990] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.567413] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.567413] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.567622] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.567891] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.568394] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.568564] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.568898] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.569079] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.569320] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.569481] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 626.569623] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 626.569771] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 626.569907] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 626.570098] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 626.570317] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 626.574217] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.574360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.574431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.574647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.574739] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.575024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.575116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.575208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.575412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.575573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.575694] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ffed21-0b3b-46f2-aece-160a014b9767 already deleted. [ 626.575793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.593419] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 626.593606] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 626.593748] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 626.594027] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.594416] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-717090ab-f25f-47b9-8b80-3c147cf1c32c taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.594653] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-717090ab-f25f-47b9-8b80-3c147cf1c32c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.594793] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-717090ab-f25f-47b9-8b80-3c147cf1c32c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.595225] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-717090ab-f25f-47b9-8b80-3c147cf1c32c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.595359] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('717090ab-f25f-47b9-8b80-3c147cf1c32c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.765802] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.766058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.766140] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.766420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.766589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.768012] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7 already deleted. [ 626.768175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.103027] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.103027] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.103027] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.103027] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.103027] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.103027] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 717090ab-f25f-47b9-8b80-3c147cf1c32c not found, creating... [ 627.103027] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.103027] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.104138] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.106315] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.106315] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.106315] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.106315] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.106315] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.108972] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.108972] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.108972] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 717090ab-f25f-47b9-8b80-3c147cf1c32c is going to be created. [ 627.136022] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.136022] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.136022] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.136022] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.136022] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.136022] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-717090ab-f25f-47b9-8b80-3c147cf1c32c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.663751] env[65413]: INFO networking_nsxv3.common.synchronization [None req-ef1553e2-ba7b-4b6f-952a-f8e5cef66377 None None] Enqueued Resource ID: 47623df6-ebba-4388-b9a0-fd632cd7ae0a with Priority: HIGHEST for action port [ 627.664978] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47623df6-ebba-4388-b9a0-fd632cd7ae0a with Priority: HIGHEST for action port [ 627.665419] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-47623df6-ebba-4388-b9a0-fd632cd7ae0a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.665819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47623df6-ebba-4388-b9a0-fd632cd7ae0a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.666321] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47623df6-ebba-4388-b9a0-fd632cd7ae0a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.666647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47623df6-ebba-4388-b9a0-fd632cd7ae0a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.666816] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47623df6-ebba-4388-b9a0-fd632cd7ae0a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.912990] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 627.913502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.913703] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.914120] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.914344] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.914550] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.914608] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.915093] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.915093] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.915093] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.915093] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.941365] env[65413]: INFO networking_nsxv3.common.synchronization [req-1c3d3a18-7a6e-41c7-b8a7-cabef966ae15 req-94cafe4a-3575-4a8d-baa7-f629e9e97313 service nova] Enqueued Resource ID: 14ffed21-0b3b-46f2-aece-160a014b9767 with Priority: HIGHEST for action security_group_rules [ 627.941519] env[65413]: INFO networking_nsxv3.common.synchronization [req-1c3d3a18-7a6e-41c7-b8a7-cabef966ae15 req-94cafe4a-3575-4a8d-baa7-f629e9e97313 service nova] Enqueued Resource ID: 14ffed21-0b3b-46f2-aece-160a014b9767 with Priority: HIGHEST for action security_group_members [ 627.941912] env[65413]: INFO networking_nsxv3.common.synchronization [req-1c3d3a18-7a6e-41c7-b8a7-cabef966ae15 req-94cafe4a-3575-4a8d-baa7-f629e9e97313 service nova] Enqueued Resource ID: 717090ab-f25f-47b9-8b80-3c147cf1c32c with Priority: HIGHEST for action port [ 627.942571] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ffed21-0b3b-46f2-aece-160a014b9767 with Priority: HIGHEST for action security_group_rules [ 627.942571] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ffed21-0b3b-46f2-aece-160a014b9767 with Priority: HIGHEST for action security_group_members [ 627.942723] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 717090ab-f25f-47b9-8b80-3c147cf1c32c with Priority: HIGHEST for action port [ 627.943098] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14ffed21-0b3b-46f2-aece-160a014b9767 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.943393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.943517] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.943801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.943893] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14ffed21-0b3b-46f2-aece-160a014b9767',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.945299] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ffed21-0b3b-46f2-aece-160a014b9767 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.945481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.945481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.945965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.946094] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.946216] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.946216] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.946789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.946789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.946789] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14ffed21-0b3b-46f2-aece-160a014b9767',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.948470] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-717090ab-f25f-47b9-8b80-3c147cf1c32c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.948470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-717090ab-f25f-47b9-8b80-3c147cf1c32c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.948470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-717090ab-f25f-47b9-8b80-3c147cf1c32c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.948697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-717090ab-f25f-47b9-8b80-3c147cf1c32c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.948842] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('717090ab-f25f-47b9-8b80-3c147cf1c32c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.143814] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 in Status: SUCCESS [ 628.144014] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 deletion is rescheduled due to dependency. [ 628.144188] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.170062] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47623df6-ebba-4388-b9a0-fd632cd7ae0a [ 628.170318] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.170469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.170591] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.171208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.171326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.171424] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47623df6-ebba-4388-b9a0-fd632cd7ae0a already deleted. [ 628.171511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47623df6-ebba-4388-b9a0-fd632cd7ae0a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.418102] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.418342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.418342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.418646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.419634] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.419634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.419634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.419634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.419634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.419634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.419634] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.419634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.420338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.420338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.420338] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.420338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.420338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.420338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.420338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.420738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.420738] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.445975] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ffed21-0b3b-46f2-aece-160a014b9767 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.446412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.449134] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14ffed21-0b3b-46f2-aece-160a014b9767',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.452274] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 717090ab-f25f-47b9-8b80-3c147cf1c32c with status ACTIVE [ 628.452400] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.455555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.455555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.455555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.455555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.455776] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.455776] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.455925] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.456870] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.457060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.457283] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.457406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.457470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.457675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.457842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.457842] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 717090ab-f25f-47b9-8b80-3c147cf1c32c is going to be updated. [ 628.488970] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.488970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.488970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.488970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.488970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.489451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-717090ab-f25f-47b9-8b80-3c147cf1c32c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.918152] env[65413]: INFO networking_nsxv3.common.synchronization [req-ef370680-67ab-41af-b511-b069cb793e49 req-d3f1f66f-a5cb-4490-8782-ec7ae07d7ddc tempest-ServersWithSpecificFlavorTestJSON-163220255 tempest-ServersWithSpecificFlavorTestJSON-163220255-project-member] Enqueued Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_members [ 628.918152] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_members [ 628.919386] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.919386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.919386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.919386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.919386] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.919386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.919386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.919772] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.919772] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.919772] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.925248] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d96dd8be-7e0f-4527-b6b4-1fd21b89c256: rpc.has_security_group_logging(os_id): False [ 628.947222] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.947419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.947487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.949981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.949981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.949981] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.949981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.949981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.949981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.949981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.949981] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.949981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.949981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.949981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.949981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.949981] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.949981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.950726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.950726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.952288] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.952508] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be created. [ 628.960883] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14ffed21-0b3b-46f2-aece-160a014b9767',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.027763] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.027763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.027763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.027763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.027763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.045546] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 629.422395] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.422557] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.422630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.422869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.422964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.423180] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.423283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.423348] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.423501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.423577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.423663] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 already deleted. [ 629.423742] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.464755] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.464936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.465070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.465339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.465339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.465448] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ffed21-0b3b-46f2-aece-160a014b9767 is going to be created. [ 629.500284] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.500482] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.500482] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.500710] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.500863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.514674] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ffed21-0b3b-46f2-aece-160a014b9767 in Status: UNINITIALIZED for 2s [ 629.546025] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.546025] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-863" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.546025] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-863" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.546025] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-863" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.547223] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.550370] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.550370] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.550370] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.550370] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.550370] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.550370] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.550370] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.550370] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.550370] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.550370] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.550849] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.577190] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.577190] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 629.577190] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.577190] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-863" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.577190] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.577190] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.577190] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.577190] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.577190] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.079492] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.079884] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.079884] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.080158] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.080396] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.080555] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66 not found, creating... [ 630.080819] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.081023] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.081156] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.081323] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.081640] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.081828] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.081990] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.082525] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.082776] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.082970] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.083280] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66 is going to be created. [ 630.126300] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.126300] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.126300] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.126300] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.126300] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.126846] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.892482] env[65413]: INFO networking_nsxv3.common.synchronization [req-ef370680-67ab-41af-b511-b069cb793e49 req-08c36e58-904a-4291-bcd5-d5c54ad2ba44 service nova] Enqueued Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_rules [ 630.892934] env[65413]: INFO networking_nsxv3.common.synchronization [req-ef370680-67ab-41af-b511-b069cb793e49 req-08c36e58-904a-4291-bcd5-d5c54ad2ba44 service nova] Enqueued Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_members [ 630.893060] env[65413]: INFO networking_nsxv3.common.synchronization [req-ef370680-67ab-41af-b511-b069cb793e49 req-08c36e58-904a-4291-bcd5-d5c54ad2ba44 service nova] Enqueued Resource ID: cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66 with Priority: HIGHEST for action port [ 630.893880] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_rules [ 630.894227] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_members [ 630.894428] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66 with Priority: HIGHEST for action port [ 630.894871] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.895076] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.895202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.895539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.895679] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.897185] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.897679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.897679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.897821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.898077] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.898257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.898373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.898647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.898836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.898985] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.900334] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.900527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.900648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.900978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.901159] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.062835] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 631.063038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.403824] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.404922] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.405052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.405211] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66 with status ACTIVE [ 631.405363] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.405478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.405527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.405730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.405818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.405987] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.406093] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.406415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.406415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.406525] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.406835] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.406979] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.409086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.409336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.409479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.409890] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66 is going to be updated. [ 631.413799] env[65413]: INFO networking_nsxv3.common.synchronization [req-06d0c850-6375-4555-8e18-07e9465ac4c3 req-58138b68-717e-4ea1-aa0b-8e80f3e5e1cc tempest-SecurityGroupRulesNegativeTestJSON-882774724 tempest-SecurityGroupRulesNegativeTestJSON-882774724-project-member] Enqueued Resource ID: 071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7 with Priority: HIGHEST for action security_group_rules [ 631.414596] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7 with Priority: HIGHEST for action security_group_rules [ 631.414982] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.415116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.415184] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.415456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.415636] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.439671] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.440012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.440012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.440265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.440428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.440879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd0c7bf4-c84d-49ff-ad68-d2c6ed02ff66" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.540290] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ffed21-0b3b-46f2-aece-160a014b9767 in Status: SUCCESS [ 631.540501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.540671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.540976] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.541116] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.541260] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.541328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.541495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.541576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.541665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.541836] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14ffed21-0b3b-46f2-aece-160a014b9767',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.913539] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.955685] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.955837] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.955837] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.956064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.956573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.956573] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7 already deleted. [ 631.956573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-071d3c6a-ab6b-43ad-a6eb-3a0c25442fd7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.046395] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ffed21-0b3b-46f2-aece-160a014b9767 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.046694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.046694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.047098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.047507] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.047684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.047780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.047967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.048208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.048335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.048807] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ffed21-0b3b-46f2-aece-160a014b9767 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.048807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.052037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.052037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.052037] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.052037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.052037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.052037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.052037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.052037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.052037] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14ffed21-0b3b-46f2-aece-160a014b9767',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.417647] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.418113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.418113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.418964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.418964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.418964] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 is going to be created. [ 632.457012] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.457222] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.457444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.457607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.457825] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.486562] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 in Status: UNINITIALIZED for 2s [ 632.555122] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14ffed21-0b3b-46f2-aece-160a014b9767: rpc.has_security_group_logging(os_id): False [ 632.580046] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.580046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.580046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.580046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.580046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.580046] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.580046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.580046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.580046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.580046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.580046] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.580046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.580046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.580046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.580046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.580713] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.580713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.580713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.580713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.580713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.580713] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14ffed21-0b3b-46f2-aece-160a014b9767 is going to be created. [ 632.586246] env[65413]: INFO networking_nsxv3.common.synchronization [req-d706a6cb-91cc-4744-a502-d0db303348d9 req-f5df027c-1b4e-4a16-93ca-76ea86c033f8 tempest-TenantUsagesTestJSON-289145301 tempest-TenantUsagesTestJSON-289145301-project-member] Enqueued Resource ID: fd87052e-7745-4df2-93d7-5efc42c58438 with Priority: HIGHEST for action security_group_members [ 632.586797] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd87052e-7745-4df2-93d7-5efc42c58438 with Priority: HIGHEST for action security_group_members [ 632.587089] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-fd87052e-7745-4df2-93d7-5efc42c58438 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.587226] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.587602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.587602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.587672] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.587734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.587799] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.587948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.588053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.588560] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fd87052e-7745-4df2-93d7-5efc42c58438',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.660039] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.660282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.660282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.660593] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.660692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.676915] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14ffed21-0b3b-46f2-aece-160a014b9767 in Status: IN_PROGRESS for 2s [ 633.091855] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.092060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.092114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.093036] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.093036] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.093036] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.093036] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.093036] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.093036] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.093036] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.093366] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd87052e-7745-4df2-93d7-5efc42c58438 is going to be updated. [ 633.132046] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.132046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.132046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.132046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.132046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.143497] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd87052e-7745-4df2-93d7-5efc42c58438 in Status: IN_PROGRESS for 2s [ 633.201231] env[65413]: INFO networking_nsxv3.common.synchronization [req-30173cb7-dffe-4376-85b0-2dd75870d2f0 req-17564cc2-06d3-48ea-898e-93a0c6f8bd6a tempest-ImagesOneServerNegativeTestJSON-1663656844 tempest-ImagesOneServerNegativeTestJSON-1663656844-project-member] Enqueued Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 633.201850] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 633.203506] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.203506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.203506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.203506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.203506] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.203506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.203506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.203506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.203506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.203506] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.706033] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.706452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.706452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.706527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.706578] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.706781] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.707015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.707097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.707295] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.707377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.707463] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 already deleted. [ 633.707565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.357611] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.357891] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-327" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.357891] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-327" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.358674] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-327" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.358674] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.358674] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.358914] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.359384] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.359384] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.359795] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.359795] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.359795] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.359795] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.360080] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.360275] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.360403] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.380661] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.380940] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 634.380940] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.381202] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-327" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.381452] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-e69127bb-7578-4efc-9d87-5515fd31ec82 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.381796] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-e69127bb-7578-4efc-9d87-5515fd31ec82" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.381796] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-e69127bb-7578-4efc-9d87-5515fd31ec82" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.382065] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-e69127bb-7578-4efc-9d87-5515fd31ec82" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.382193] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e69127bb-7578-4efc-9d87-5515fd31ec82',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.507927] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 in Status: SUCCESS [ 634.509782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.509782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.509782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.509782] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.509782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.509782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.509782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.509782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.510259] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.510259] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.557874] env[65413]: INFO networking_nsxv3.common.synchronization [None req-2927a972-5193-4cfe-9ae1-6c0c0184f81d None None] Enqueued Resource ID: 29c73fce-9c02-4a65-918b-481529460628 with Priority: HIGHEST for action port [ 634.557874] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c73fce-9c02-4a65-918b-481529460628 with Priority: HIGHEST for action port [ 634.558220] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-29c73fce-9c02-4a65-918b-481529460628 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.558291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29c73fce-9c02-4a65-918b-481529460628" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.558708] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29c73fce-9c02-4a65-918b-481529460628" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.558708] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29c73fce-9c02-4a65-918b-481529460628" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.558913] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29c73fce-9c02-4a65-918b-481529460628',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.694154] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14ffed21-0b3b-46f2-aece-160a014b9767 in Status: SUCCESS [ 634.694154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.885184] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.885699] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.885699] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.886144] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.886410] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.886591] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port e69127bb-7578-4efc-9d87-5515fd31ec82 not found, creating... [ 634.887715] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.887715] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.887715] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.887974] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.888904] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.889348] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.889516] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.889670] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.890191] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.890368] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.890539] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: e69127bb-7578-4efc-9d87-5515fd31ec82 is going to be created. [ 634.914566] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.914566] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.914566] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.918157] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.918629] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.918743] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-e69127bb-7578-4efc-9d87-5515fd31ec82" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.012420] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.062074] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29c73fce-9c02-4a65-918b-481529460628 [ 635.062074] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.062223] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.062223] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.062497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.062628] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.062763] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29c73fce-9c02-4a65-918b-481529460628 already deleted. [ 635.064655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29c73fce-9c02-4a65-918b-481529460628" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.155971] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fd87052e-7745-4df2-93d7-5efc42c58438 in Status: SUCCESS [ 635.156257] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fd87052e-7745-4df2-93d7-5efc42c58438 deletion is rescheduled due to dependency. [ 635.156380] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.436009] env[65413]: INFO networking_nsxv3.common.synchronization [None req-4ed23277-a0aa-4e15-b7b6-731d47a7fea2 None None] Enqueued Resource ID: b126d1e1-c0f8-46fa-9cda-3c57d1b4e704 with Priority: HIGHEST for action port [ 635.436009] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b126d1e1-c0f8-46fa-9cda-3c57d1b4e704 with Priority: HIGHEST for action port [ 635.437106] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-b126d1e1-c0f8-46fa-9cda-3c57d1b4e704 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.437285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b126d1e1-c0f8-46fa-9cda-3c57d1b4e704" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.437384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b126d1e1-c0f8-46fa-9cda-3c57d1b4e704" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.437677] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b126d1e1-c0f8-46fa-9cda-3c57d1b4e704" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.437782] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b126d1e1-c0f8-46fa-9cda-3c57d1b4e704',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.514798] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100: rpc.has_security_group_logging(os_id): False [ 635.540233] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.540233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.540233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.540233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.540553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.540696] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.540750] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.540869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.541949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.541949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.541949] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 is going to be created. [ 635.634375] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.634375] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.634375] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.634375] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.634375] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.659708] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 in Status: IN_PROGRESS for 2s [ 635.724052] env[65413]: INFO networking_nsxv3.common.synchronization [req-30173cb7-dffe-4376-85b0-2dd75870d2f0 req-4c82cb7e-10fd-4bb3-a7b4-dbbf1ccc72e5 service nova] Enqueued Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_rules [ 635.724052] env[65413]: INFO networking_nsxv3.common.synchronization [req-30173cb7-dffe-4376-85b0-2dd75870d2f0 req-4c82cb7e-10fd-4bb3-a7b4-dbbf1ccc72e5 service nova] Enqueued Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 635.724052] env[65413]: INFO networking_nsxv3.common.synchronization [req-30173cb7-dffe-4376-85b0-2dd75870d2f0 req-4c82cb7e-10fd-4bb3-a7b4-dbbf1ccc72e5 service nova] Enqueued Resource ID: e69127bb-7578-4efc-9d87-5515fd31ec82 with Priority: HIGHEST for action port [ 635.724444] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_rules [ 635.724444] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 635.724568] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e69127bb-7578-4efc-9d87-5515fd31ec82 with Priority: HIGHEST for action port [ 635.724911] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.725074] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.725144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.725546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.725546] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.729153] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.729529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.729529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.730035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.730120] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.730220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.730297] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.730513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.730628] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.730740] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.731841] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-e69127bb-7578-4efc-9d87-5515fd31ec82 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.731981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e69127bb-7578-4efc-9d87-5515fd31ec82" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.732068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e69127bb-7578-4efc-9d87-5515fd31ec82" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.732324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e69127bb-7578-4efc-9d87-5515fd31ec82" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.732483] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e69127bb-7578-4efc-9d87-5515fd31ec82',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.940047] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b126d1e1-c0f8-46fa-9cda-3c57d1b4e704 [ 635.940437] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.940518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.940565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.941066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.941066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.941066] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b126d1e1-c0f8-46fa-9cda-3c57d1b4e704 already deleted. [ 635.941066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b126d1e1-c0f8-46fa-9cda-3c57d1b4e704" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.235250] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.237899] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.238625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.238625] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e69127bb-7578-4efc-9d87-5515fd31ec82 with status ACTIVE [ 636.239072] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.239398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.239641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.239994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.240203] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.240554] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.240729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.240873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.241206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.241370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.241713] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.241910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.242051] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.242568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.242568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.242733] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e69127bb-7578-4efc-9d87-5515fd31ec82 is going to be updated. [ 636.270167] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.270660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.270660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.270808] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.270940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.271184] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e69127bb-7578-4efc-9d87-5515fd31ec82" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.555546] env[65413]: INFO networking_nsxv3.common.synchronization [req-86e2f447-f9c0-4ee0-8f56-dae298f57489 req-688d59f7-8579-4ffe-a28e-94e92f2571fa tempest-MultipleCreateTestJSON-1512040954 tempest-MultipleCreateTestJSON-1512040954-project-member] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 636.556689] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 636.557267] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.557426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.557492] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.557760] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.558479] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.558479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.558479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.558479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.558827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.558827] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.749034] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.771685] env[65413]: INFO networking_nsxv3.common.synchronization [req-8984f9cf-1a05-4ad4-b075-fe9f5243abc7 req-1e398736-c21e-40fe-82ea-81db701fb829 tempest-ListImageFiltersTestJSON-953550076 tempest-ListImageFiltersTestJSON-953550076-project-member] Enqueued Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_members [ 636.772716] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_members [ 636.773224] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6548500-a35c-4067-ba0a-a6f94326b3ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.773412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.773521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.773956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.774440] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.774440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.774440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.775261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.775261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.775261] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.931486] env[65413]: INFO networking_nsxv3.common.synchronization [None req-65eebdbf-e2a0-4c83-819f-8d337162ef90 None None] Enqueued Resource ID: f85ef5e8-d49f-47a4-957d-cd1a72ca8b41 with Priority: HIGHEST for action port [ 636.932628] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f85ef5e8-d49f-47a4-957d-cd1a72ca8b41 with Priority: HIGHEST for action port [ 636.932628] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-f85ef5e8-d49f-47a4-957d-cd1a72ca8b41 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.932628] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f85ef5e8-d49f-47a4-957d-cd1a72ca8b41" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.932628] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f85ef5e8-d49f-47a4-957d-cd1a72ca8b41" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.932904] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f85ef5e8-d49f-47a4-957d-cd1a72ca8b41" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.932904] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f85ef5e8-d49f-47a4-957d-cd1a72ca8b41',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.061597] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.252863] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.253172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.253264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.253514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.253613] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.253746] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 is going to be created. [ 637.281040] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.281279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.281279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.281631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.281757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.281972] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.282085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.282181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.282315] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.282392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.282489] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6548500-a35c-4067-ba0a-a6f94326b3ef already deleted. [ 637.282571] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.287629] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.287858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.287858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.288110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.288305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.304511] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: UNINITIALIZED for 2s [ 637.315995] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.316215] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.316334] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.317212] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.317598] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.317842] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.318019] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.318342] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.318571] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.318993] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.319238] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 637.319380] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 637.319543] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 637.319716] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 637.319921] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 637.320107] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 637.346820] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 637.347076] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 637.347235] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 637.347420] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.347768] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-84dc4127-415a-4273-8156-64f412e88089 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.347950] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-84dc4127-415a-4273-8156-64f412e88089" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.348079] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-84dc4127-415a-4273-8156-64f412e88089" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.348458] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-84dc4127-415a-4273-8156-64f412e88089" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.348609] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84dc4127-415a-4273-8156-64f412e88089',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.439264] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f85ef5e8-d49f-47a4-957d-cd1a72ca8b41 [ 637.439802] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.439802] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.439802] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.440034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.440131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.440365] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f85ef5e8-d49f-47a4-957d-cd1a72ca8b41 already deleted. [ 637.440458] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f85ef5e8-d49f-47a4-957d-cd1a72ca8b41" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.566971] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.672495] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 in Status: SUCCESS [ 637.672788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.852090] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.852389] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.852522] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.852845] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.853067] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.853295] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 84dc4127-415a-4273-8156-64f412e88089 not found, creating... [ 637.853711] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.853950] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.854135] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.854466] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.854678] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.855134] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.855367] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.855529] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.855842] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.856052] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.856303] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 84dc4127-415a-4273-8156-64f412e88089 is going to be created. [ 637.880416] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.880644] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.880762] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.881049] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.881360] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.881581] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-84dc4127-415a-4273-8156-64f412e88089" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.071777] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.071777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.071777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.071777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.071777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.071777] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be updated. [ 638.106337] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.106521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.106595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.106838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.107098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.130721] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: IN_PROGRESS for 2s [ 638.451162] env[65413]: INFO networking_nsxv3.common.synchronization [None req-7b0cd1f8-e5b3-4422-83ef-1bcd361de908 None None] Enqueued Resource ID: ea0ba284-1e22-4bcf-a7bb-62c41e73a40e with Priority: HIGHEST for action port [ 638.451162] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea0ba284-1e22-4bcf-a7bb-62c41e73a40e with Priority: HIGHEST for action port [ 638.451723] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-ea0ba284-1e22-4bcf-a7bb-62c41e73a40e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.451941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ea0ba284-1e22-4bcf-a7bb-62c41e73a40e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.452056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ea0ba284-1e22-4bcf-a7bb-62c41e73a40e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.453044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ea0ba284-1e22-4bcf-a7bb-62c41e73a40e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.453044] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ea0ba284-1e22-4bcf-a7bb-62c41e73a40e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.628364] env[65413]: INFO networking_nsxv3.common.synchronization [req-8984f9cf-1a05-4ad4-b075-fe9f5243abc7 req-300a4c34-9830-4878-a081-774cc4e1d250 service nova] Enqueued Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_rules [ 638.628549] env[65413]: INFO networking_nsxv3.common.synchronization [req-8984f9cf-1a05-4ad4-b075-fe9f5243abc7 req-300a4c34-9830-4878-a081-774cc4e1d250 service nova] Enqueued Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_members [ 638.628682] env[65413]: INFO networking_nsxv3.common.synchronization [req-8984f9cf-1a05-4ad4-b075-fe9f5243abc7 req-300a4c34-9830-4878-a081-774cc4e1d250 service nova] Enqueued Resource ID: 84dc4127-415a-4273-8156-64f412e88089 with Priority: HIGHEST for action port [ 638.629336] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_rules [ 638.629544] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_members [ 638.629700] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84dc4127-415a-4273-8156-64f412e88089 with Priority: HIGHEST for action port [ 638.630371] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6548500-a35c-4067-ba0a-a6f94326b3ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.630503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.630857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.630857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.630973] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.633525] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6548500-a35c-4067-ba0a-a6f94326b3ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.633697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.633770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.633990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.634179] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.634284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.634351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.634509] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.634595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.634692] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.635596] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-84dc4127-415a-4273-8156-64f412e88089 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.635704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-84dc4127-415a-4273-8156-64f412e88089" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.635771] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-84dc4127-415a-4273-8156-64f412e88089" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.636076] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-84dc4127-415a-4273-8156-64f412e88089" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.636076] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('84dc4127-415a-4273-8156-64f412e88089',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.954476] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ea0ba284-1e22-4bcf-a7bb-62c41e73a40e [ 638.956163] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.956163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.956163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.956163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.956163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.956163] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ea0ba284-1e22-4bcf-a7bb-62c41e73a40e already deleted. [ 638.956163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ea0ba284-1e22-4bcf-a7bb-62c41e73a40e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.137991] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.141047] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6548500-a35c-4067-ba0a-a6f94326b3ef taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.141047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.141047] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 84dc4127-415a-4273-8156-64f412e88089 with status ACTIVE [ 639.141047] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.141047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.141047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.143064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.143064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.143174] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.143232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.143349] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.147161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.147320] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.147588] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.147717] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.148097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.148097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.148097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.148270] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 84dc4127-415a-4273-8156-64f412e88089 is going to be updated. [ 639.180312] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.180312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.180312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.180312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.180312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.180312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-84dc4127-415a-4273-8156-64f412e88089" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.259122] env[65413]: INFO networking_nsxv3.common.synchronization [req-8a83de11-7650-4607-bc3b-6e636e3fe108 req-a26b6fe4-a232-41a4-8614-4c2db7631068 tempest-DeleteServersAdminTestJSON-65358818 tempest-DeleteServersAdminTestJSON-65358818-project-member] Enqueued Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_members [ 639.259807] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_members [ 639.260340] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d03374-02a8-4013-ba8d-fa57c3795178 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.260619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.260772] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.261109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.261563] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.261563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.261664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.261784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.261878] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.261986] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.334769] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: SUCCESS [ 639.335041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.335284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.335568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.335951] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.335951] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.336101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.336489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.336489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.336489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.336614] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.650796] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.765368] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.765693] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.765693] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.765933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.766122] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.767322] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.767322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.767322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.767322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.767322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.768923] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d03374-02a8-4013-ba8d-fa57c3795178 is going to be updated. [ 639.828351] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.828620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.828620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.828825] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.829011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.840794] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.840794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.840794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.841141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.841141] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.841314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.841400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.841654] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.842172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.842172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.842172] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.842172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.842467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.842467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.842549] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.842643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.842709] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.842835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.842900] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.843416] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.843524] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.845369] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d03374-02a8-4013-ba8d-fa57c3795178 in Status: IN_PROGRESS for 2s [ 639.847976] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.849047] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.849047] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.849459] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.849942] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.850167] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.850549] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.851135] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.851135] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.851366] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.851366] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 639.851498] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 639.851633] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 639.851746] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 639.851858] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 639.852167] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 639.881086] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 639.881086] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 639.881086] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 639.881323] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.881642] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-91b2400f-665a-4ddd-bf7e-8aacbf8ca615 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.881880] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-91b2400f-665a-4ddd-bf7e-8aacbf8ca615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.882151] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-91b2400f-665a-4ddd-bf7e-8aacbf8ca615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.882466] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-91b2400f-665a-4ddd-bf7e-8aacbf8ca615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.882582] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91b2400f-665a-4ddd-bf7e-8aacbf8ca615',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.148551] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: SUCCESS [ 640.148954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.157136] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.157136] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.157136] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.157136] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.157136] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.157724] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6548500-a35c-4067-ba0a-a6f94326b3ef is going to be created. [ 640.188574] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.188716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.188788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.189327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.189327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.203709] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6548500-a35c-4067-ba0a-a6f94326b3ef in Status: UNINITIALIZED for 2s [ 640.354676] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d036f63-388f-4a40-b3dc-855ae378cbe3: rpc.has_security_group_logging(os_id): False [ 640.385751] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.386028] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.386156] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.386454] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.386586] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.386756] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 91b2400f-665a-4ddd-bf7e-8aacbf8ca615 not found, creating... [ 640.387051] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.387214] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.387325] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.387668] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.387803] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.389097] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.389656] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.389996] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.390399] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.390630] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.390846] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 91b2400f-665a-4ddd-bf7e-8aacbf8ca615 is going to be created. [ 640.394415] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.394415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.394625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.394963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.395195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.396504] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.396684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.396786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.397590] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.397590] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.397706] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.398206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.398206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.398206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.398308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.398615] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.398768] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.398858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.399283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.399283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.399384] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 is going to be created. [ 640.432117] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.432117] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.432117] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.432117] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.432117] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.432117] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-91b2400f-665a-4ddd-bf7e-8aacbf8ca615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.439943] env[65413]: INFO networking_nsxv3.common.synchronization [req-873bbc8f-1a28-47dd-8cc0-9a4ee17e29bc req-ddf670dd-e6a6-41f0-bf5c-859471240a83 tempest-FloatingIPsAssociationNegativeTestJSON-275466521 tempest-FloatingIPsAssociationNegativeTestJSON-275466521-project-member] Enqueued Resource ID: cd34bb24-11b2-4ccc-9316-b0c847939508 with Priority: HIGHEST for action security_group_members [ 640.440243] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd34bb24-11b2-4ccc-9316-b0c847939508 with Priority: HIGHEST for action security_group_members [ 640.441044] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd34bb24-11b2-4ccc-9316-b0c847939508 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.441398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.441398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.441609] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.441871] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.442038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.442146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.442626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.442626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.442626] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd34bb24-11b2-4ccc-9316-b0c847939508',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.471195] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.471195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.471195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.471195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.471195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.485840] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: IN_PROGRESS for 2s [ 640.947289] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.947515] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.947598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.947876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.947996] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.948287] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.948426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.948511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.948732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.948832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.948948] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd34bb24-11b2-4ccc-9316-b0c847939508 already deleted. [ 640.949067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.183387] env[65413]: INFO networking_nsxv3.common.synchronization [req-8a83de11-7650-4607-bc3b-6e636e3fe108 req-8f1903d9-5575-4b8c-98e2-c56c16be822f service nova] Enqueued Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_rules [ 641.183387] env[65413]: INFO networking_nsxv3.common.synchronization [req-8a83de11-7650-4607-bc3b-6e636e3fe108 req-8f1903d9-5575-4b8c-98e2-c56c16be822f service nova] Enqueued Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_members [ 641.183387] env[65413]: INFO networking_nsxv3.common.synchronization [req-8a83de11-7650-4607-bc3b-6e636e3fe108 req-8f1903d9-5575-4b8c-98e2-c56c16be822f service nova] Enqueued Resource ID: 91b2400f-665a-4ddd-bf7e-8aacbf8ca615 with Priority: HIGHEST for action port [ 641.184041] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_rules [ 641.184197] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_members [ 641.184346] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91b2400f-665a-4ddd-bf7e-8aacbf8ca615 with Priority: HIGHEST for action port [ 641.184736] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d03374-02a8-4013-ba8d-fa57c3795178 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.184915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.185244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.185319] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.185435] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.186599] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d03374-02a8-4013-ba8d-fa57c3795178 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.186737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.187011] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-91b2400f-665a-4ddd-bf7e-8aacbf8ca615 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.187221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91b2400f-665a-4ddd-bf7e-8aacbf8ca615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.187261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91b2400f-665a-4ddd-bf7e-8aacbf8ca615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.188889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91b2400f-665a-4ddd-bf7e-8aacbf8ca615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.188889] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91b2400f-665a-4ddd-bf7e-8aacbf8ca615',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.202346] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-93 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.204591] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-93" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.204591] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-93" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.204591] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-93" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.204591] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.204591] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.205150] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.205306] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.205519] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.205805] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.206211] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.206389] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.206553] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.206718] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.206874] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.207085] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.231930] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.232170] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 641.232263] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.232438] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-93" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.232886] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-c2477dfb-be0a-462f-88f9-d0aeaae488bd taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.233129] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-c2477dfb-be0a-462f-88f9-d0aeaae488bd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.233297] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-c2477dfb-be0a-462f-88f9-d0aeaae488bd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.233684] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-c2477dfb-be0a-462f-88f9-d0aeaae488bd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.233917] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2477dfb-be0a-462f-88f9-d0aeaae488bd',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.690177] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d03374-02a8-4013-ba8d-fa57c3795178 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.691042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.691254] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91b2400f-665a-4ddd-bf7e-8aacbf8ca615 with status ACTIVE [ 641.691492] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.691694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.691832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.692197] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.692308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.692612] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.692789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.692965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.693635] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.693635] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.693811] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.693904] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.693971] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.694457] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.694607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.694718] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91b2400f-665a-4ddd-bf7e-8aacbf8ca615 is going to be updated. [ 641.729061] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.729289] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.729289] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.729513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.730337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.730471] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91b2400f-665a-4ddd-bf7e-8aacbf8ca615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.736647] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.736898] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.737060] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.737360] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.737501] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.737706] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port c2477dfb-be0a-462f-88f9-d0aeaae488bd not found, creating... [ 641.738020] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.738269] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.738382] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.738622] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.738758] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.739219] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.739356] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.739468] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.739690] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.739817] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.739982] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: c2477dfb-be0a-462f-88f9-d0aeaae488bd is going to be created. [ 641.780721] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.780953] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.781015] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.781366] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.781634] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.781841] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-c2477dfb-be0a-462f-88f9-d0aeaae488bd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.874816] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d03374-02a8-4013-ba8d-fa57c3795178 in Status: SUCCESS [ 641.874816] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d03374-02a8-4013-ba8d-fa57c3795178 deletion is rescheduled due to dependency. [ 641.874816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.874816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.874816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.874816] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.874816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.874816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.874816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.875384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.875384] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.224171] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6548500-a35c-4067-ba0a-a6f94326b3ef in Status: SUCCESS [ 642.224616] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.224921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.225180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.225381] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.225499] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.225556] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.225710] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.225794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.225878] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.225967] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.378181] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.473722] env[65413]: INFO networking_nsxv3.common.synchronization [req-873bbc8f-1a28-47dd-8cc0-9a4ee17e29bc req-d0d7d7b1-a7b9-4942-bd13-0f9b0a73d512 service nova] Enqueued Resource ID: cd34bb24-11b2-4ccc-9316-b0c847939508 with Priority: HIGHEST for action security_group_rules [ 642.473892] env[65413]: INFO networking_nsxv3.common.synchronization [req-873bbc8f-1a28-47dd-8cc0-9a4ee17e29bc req-d0d7d7b1-a7b9-4942-bd13-0f9b0a73d512 service nova] Enqueued Resource ID: cd34bb24-11b2-4ccc-9316-b0c847939508 with Priority: HIGHEST for action security_group_members [ 642.474028] env[65413]: INFO networking_nsxv3.common.synchronization [req-873bbc8f-1a28-47dd-8cc0-9a4ee17e29bc req-d0d7d7b1-a7b9-4942-bd13-0f9b0a73d512 service nova] Enqueued Resource ID: c2477dfb-be0a-462f-88f9-d0aeaae488bd with Priority: HIGHEST for action port [ 642.476531] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd34bb24-11b2-4ccc-9316-b0c847939508 with Priority: HIGHEST for action security_group_rules [ 642.476531] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd34bb24-11b2-4ccc-9316-b0c847939508 with Priority: HIGHEST for action security_group_members [ 642.476531] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2477dfb-be0a-462f-88f9-d0aeaae488bd with Priority: HIGHEST for action port [ 642.476531] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cd34bb24-11b2-4ccc-9316-b0c847939508 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.476531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.476531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.476531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.476531] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cd34bb24-11b2-4ccc-9316-b0c847939508',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.481406] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd34bb24-11b2-4ccc-9316-b0c847939508 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.481473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.481507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.482031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.482031] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.482169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.482169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.482298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.482370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.482464] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd34bb24-11b2-4ccc-9316-b0c847939508',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.483536] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2477dfb-be0a-462f-88f9-d0aeaae488bd taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.483660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2477dfb-be0a-462f-88f9-d0aeaae488bd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.483743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2477dfb-be0a-462f-88f9-d0aeaae488bd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.483949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2477dfb-be0a-462f-88f9-d0aeaae488bd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.484065] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2477dfb-be0a-462f-88f9-d0aeaae488bd',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.500077] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: SUCCESS [ 642.500336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.728196] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6548500-a35c-4067-ba0a-a6f94326b3ef taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.728366] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.728433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.729015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.729221] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.729330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.729428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.729917] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.730046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.730283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.730355] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6548500-a35c-4067-ba0a-a6f94326b3ef taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.730410] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.730448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.730592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.730730] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.730826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.731198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.731355] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.731424] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.731508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.731598] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.875152] env[65413]: INFO networking_nsxv3.common.synchronization [req-6bdeb5b0-2e62-4f7d-9de8-64f03e4049b6 req-da442da6-b232-490e-ae23-303acdf4f2d3 tempest-MultipleCreateTestJSON-1512040954 tempest-MultipleCreateTestJSON-1512040954-project-member] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 642.875152] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 642.875152] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.875152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.875152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.875485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.875485] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.875577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.875577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.875888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.875888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.875888] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.880635] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.987054] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c2477dfb-be0a-462f-88f9-d0aeaae488bd with status ACTIVE [ 642.987595] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.988465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.988465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.988465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.988465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.988465] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.988465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.988781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.988781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.988781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.989070] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.989161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.989161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.989313] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.989386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.989505] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c2477dfb-be0a-462f-88f9-d0aeaae488bd is going to be updated. [ 642.990841] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd34bb24-11b2-4ccc-9316-b0c847939508 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.990966] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.991118] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cd34bb24-11b2-4ccc-9316-b0c847939508',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.018614] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.018818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.018964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.019115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.019705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.019705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2477dfb-be0a-462f-88f9-d0aeaae488bd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.152166] env[65413]: INFO networking_nsxv3.common.synchronization [req-0844b057-8f72-4a8d-b914-3a0e4fd4a778 req-4d62ff83-2345-405a-831f-78a950543d82 tempest-DeleteServersTestJSON-2008533967 tempest-DeleteServersTestJSON-2008533967-project-member] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 643.152734] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 643.153037] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.153184] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.153275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.153683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.153683] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.153845] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.153845] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.154059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.154137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.154187] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.233947] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6548500-a35c-4067-ba0a-a6f94326b3ef: rpc.has_security_group_logging(os_id): False [ 643.255971] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.256207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.256207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.256432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.256547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.256736] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.256854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.256922] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.257061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.257140] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.257319] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.257414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.257474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.257616] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.257684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.257856] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.257856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.258101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.258159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.258232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.258317] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6548500-a35c-4067-ba0a-a6f94326b3ef is going to be created. [ 643.327042] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.327303] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.327303] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.327557] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.327803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.343553] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6548500-a35c-4067-ba0a-a6f94326b3ef in Status: IN_PROGRESS for 2s [ 643.378540] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.379229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.379379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.379573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.379666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.379921] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.380212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.380212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.380345] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.382044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.382044] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be updated. [ 643.382044] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.383575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.383575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.383575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.383575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.383723] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d03374-02a8-4013-ba8d-fa57c3795178 is going to be updated. [ 643.437885] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.439045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.439045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.439045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.439045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.442420] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.442603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.442669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.442875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.443134] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.453943] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d03374-02a8-4013-ba8d-fa57c3795178 in Status: IN_PROGRESS for 2s [ 643.454835] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: IN_PROGRESS for 2s [ 643.493419] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cd34bb24-11b2-4ccc-9316-b0c847939508',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.567238] env[65413]: INFO networking_nsxv3.common.synchronization [None req-28c965b3-6096-41d1-9f8d-5fdbb7f9dd07 None None] Enqueued Resource ID: 83ed47dd-3712-45e1-87d9-a51d158c010e with Priority: HIGHEST for action port [ 643.568454] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83ed47dd-3712-45e1-87d9-a51d158c010e with Priority: HIGHEST for action port [ 643.568820] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-83ed47dd-3712-45e1-87d9-a51d158c010e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.568984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83ed47dd-3712-45e1-87d9-a51d158c010e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.569069] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83ed47dd-3712-45e1-87d9-a51d158c010e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.569348] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83ed47dd-3712-45e1-87d9-a51d158c010e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.569426] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83ed47dd-3712-45e1-87d9-a51d158c010e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.657494] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.657494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.657494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.657494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.657494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.657494] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.657819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.657819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.658545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.660293] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.661698] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 643.696790] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.697101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.697211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.697470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.697648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.708420] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 643.997485] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.997726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.997823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.999301] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.999301] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.999301] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd34bb24-11b2-4ccc-9316-b0c847939508 is going to be created. [ 644.029334] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.029334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.029334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.029651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.030104] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.041851] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd34bb24-11b2-4ccc-9316-b0c847939508 in Status: UNINITIALIZED for 2s [ 644.073690] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83ed47dd-3712-45e1-87d9-a51d158c010e [ 644.073966] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.074116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.074264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.074512] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.074580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.074750] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83ed47dd-3712-45e1-87d9-a51d158c010e already deleted. [ 644.074750] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83ed47dd-3712-45e1-87d9-a51d158c010e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.358532] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6548500-a35c-4067-ba0a-a6f94326b3ef in Status: SUCCESS [ 645.358787] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.469948] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: SUCCESS [ 645.470233] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 deletion is rescheduled due to dependency. [ 645.470305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.471112] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d03374-02a8-4013-ba8d-fa57c3795178 in Status: SUCCESS [ 645.471382] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.472109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.472109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.472109] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.473049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.473049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.473049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.473049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.473049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.473314] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.719780] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 645.719780] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 deletion is rescheduled due to dependency. [ 645.720021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.977381] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d03374-02a8-4013-ba8d-fa57c3795178 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.977620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.977620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.977858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.978036] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.978129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.978220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.978389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.978501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.978600] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.979159] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d03374-02a8-4013-ba8d-fa57c3795178 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.979159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.979159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.979159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.979450] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.979450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.979450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.979657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.979657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.979732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.979810] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.057301] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd34bb24-11b2-4ccc-9316-b0c847939508 in Status: SUCCESS [ 646.057301] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.057301] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.057301] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.057480] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.058068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.058068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.058068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.058224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.058259] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.058415] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cd34bb24-11b2-4ccc-9316-b0c847939508',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.411107] env[65413]: INFO networking_nsxv3.common.synchronization [None req-b93838f6-610b-4472-8c2e-0c16eb9d4d16 None None] Enqueued Resource ID: 0e3876ef-ae91-4528-b2bb-b32671c5402d with Priority: HIGHEST for action port [ 646.411551] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e3876ef-ae91-4528-b2bb-b32671c5402d with Priority: HIGHEST for action port [ 646.411783] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e3876ef-ae91-4528-b2bb-b32671c5402d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.411926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e3876ef-ae91-4528-b2bb-b32671c5402d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.411989] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e3876ef-ae91-4528-b2bb-b32671c5402d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.413098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e3876ef-ae91-4528-b2bb-b32671c5402d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.413208] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e3876ef-ae91-4528-b2bb-b32671c5402d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.481958] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 58d03374-02a8-4013-ba8d-fa57c3795178: rpc.has_security_group_logging(os_id): False [ 646.506248] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.506457] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.506561] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.506788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.506895] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.507170] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.507276] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.507339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.507500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.507580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.507774] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.507876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.507926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.508087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.508237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.508335] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.508425] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.508483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.508623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.508696] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.508907] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d03374-02a8-4013-ba8d-fa57c3795178 is going to be updated. [ 646.563654] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd34bb24-11b2-4ccc-9316-b0c847939508 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.563856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.563905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.566021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.566021] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.566021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.566021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.566021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.566021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.566021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.566021] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd34bb24-11b2-4ccc-9316-b0c847939508 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.566021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.566021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.566021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.566021] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.566021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.566021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.566021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.566021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.566021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.566021] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cd34bb24-11b2-4ccc-9316-b0c847939508',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.616150] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.616326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.616473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.616626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.617842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.646522] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d03374-02a8-4013-ba8d-fa57c3795178 in Status: IN_PROGRESS for 2s [ 646.915334] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e3876ef-ae91-4528-b2bb-b32671c5402d [ 646.915619] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.915758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.915827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.916076] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.916172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.916266] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e3876ef-ae91-4528-b2bb-b32671c5402d already deleted. [ 646.916363] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e3876ef-ae91-4528-b2bb-b32671c5402d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.069465] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cd34bb24-11b2-4ccc-9316-b0c847939508: rpc.has_security_group_logging(os_id): False [ 647.095193] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.095463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.095554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.095833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.095953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.096234] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.096379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.096445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.096629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.096708] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.097153] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.097299] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.097372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.097523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.097600] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.097802] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.097901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.097962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.098148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.098229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.098374] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cd34bb24-11b2-4ccc-9316-b0c847939508 is going to be created. [ 647.157649] env[65413]: INFO networking_nsxv3.common.synchronization [req-f5e1ad0a-4e45-4228-b9f0-da4088437b90 req-57c83aa8-18d7-474c-9b66-b392137e0bf6 tempest-ListImageFiltersTestJSON-953550076 tempest-ListImageFiltersTestJSON-953550076-project-member] Enqueued Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_members [ 647.158293] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_members [ 647.158704] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6548500-a35c-4067-ba0a-a6f94326b3ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.158843] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.158905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.162490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.162490] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.162490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.162490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.162490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.162490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.162490] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.196625] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.196878] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.197080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.197364] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.197584] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.225807] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd34bb24-11b2-4ccc-9316-b0c847939508 in Status: IN_PROGRESS for 2s [ 647.281527] env[65413]: INFO networking_nsxv3.common.synchronization [None req-ad65628f-b2ce-47ed-bb85-912cf0e7caec tempest-ServersTestManualDisk-948107972 tempest-ServersTestManualDisk-948107972-project-member] Enqueued Resource ID: 832015c1-81fd-4bf2-88c3-58e97531a611 with Priority: HIGHEST for action security_group_rules [ 647.282402] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832015c1-81fd-4bf2-88c3-58e97531a611 with Priority: HIGHEST for action security_group_rules [ 647.282685] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-832015c1-81fd-4bf2-88c3-58e97531a611 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.282817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.282859] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.283673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.283843] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('832015c1-81fd-4bf2-88c3-58e97531a611',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.584653] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.584653] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.584653] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.584653] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.584653] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.584653] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.584653] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.584653] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.584653] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.584653] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.584653] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.586035] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.586035] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.586035] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.586035] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.586035] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.607091] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.607431] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.607508] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.607813] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.608144] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-23bbbd7d-6e78-4be6-9d98-2f93e429cc26 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.608392] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-23bbbd7d-6e78-4be6-9d98-2f93e429cc26" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.608672] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-23bbbd7d-6e78-4be6-9d98-2f93e429cc26" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.609044] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-23bbbd7d-6e78-4be6-9d98-2f93e429cc26" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.609536] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23bbbd7d-6e78-4be6-9d98-2f93e429cc26',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.665123] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.806699] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.806699] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.806699] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.807164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.807164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.807317] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 832015c1-81fd-4bf2-88c3-58e97531a611 already deleted. [ 647.807436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.895649] env[65413]: INFO networking_nsxv3.common.synchronization [None req-0dd411a4-ce95-4a89-aefa-0dcf584c9179 None None] Enqueued Resource ID: d9193988-9f74-49d5-8126-a5e0b89e1ea8 with Priority: HIGHEST for action port [ 647.897140] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9193988-9f74-49d5-8126-a5e0b89e1ea8 with Priority: HIGHEST for action port [ 647.897381] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9193988-9f74-49d5-8126-a5e0b89e1ea8 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.897506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9193988-9f74-49d5-8126-a5e0b89e1ea8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.897575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9193988-9f74-49d5-8126-a5e0b89e1ea8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.897826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9193988-9f74-49d5-8126-a5e0b89e1ea8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.897981] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9193988-9f74-49d5-8126-a5e0b89e1ea8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.111823] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.112049] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.112132] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.112438] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.112585] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.112752] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 23bbbd7d-6e78-4be6-9d98-2f93e429cc26 not found, creating... [ 648.113391] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.113585] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.113717] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.113949] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.114266] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.114465] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.114641] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.114968] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.115077] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.115220] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.115337] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 23bbbd7d-6e78-4be6-9d98-2f93e429cc26 is going to be created. [ 648.138064] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.138359] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.138456] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.138773] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.139097] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.139339] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-23bbbd7d-6e78-4be6-9d98-2f93e429cc26" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.169799] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.330302] env[65413]: INFO networking_nsxv3.common.synchronization [None req-27addd54-b4b9-4adc-ae08-f816b8ca76ab tempest-ServersTestManualDisk-948107972 tempest-ServersTestManualDisk-948107972-project-member] Enqueued Resource ID: 832015c1-81fd-4bf2-88c3-58e97531a611 with Priority: HIGHEST for action security_group_rules [ 648.333836] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832015c1-81fd-4bf2-88c3-58e97531a611 with Priority: HIGHEST for action security_group_rules [ 648.336616] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-832015c1-81fd-4bf2-88c3-58e97531a611 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.338018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.338018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.338283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.338509] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('832015c1-81fd-4bf2-88c3-58e97531a611',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.401371] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9193988-9f74-49d5-8126-a5e0b89e1ea8 [ 648.401617] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.401758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.401828] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.402095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.402197] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.402297] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9193988-9f74-49d5-8126-a5e0b89e1ea8 already deleted. [ 648.402377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9193988-9f74-49d5-8126-a5e0b89e1ea8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.661670] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 58d03374-02a8-4013-ba8d-fa57c3795178 in Status: SUCCESS [ 648.662082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.673735] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.673815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.673871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.674131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.674225] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.674329] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6548500-a35c-4067-ba0a-a6f94326b3ef is going to be updated. [ 648.717456] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.717610] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.717708] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.718445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.718445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.730100] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6548500-a35c-4067-ba0a-a6f94326b3ef in Status: IN_PROGRESS for 2s [ 648.860707] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.860897] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.860991] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.861265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.861382] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.861483] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 832015c1-81fd-4bf2-88c3-58e97531a611 already deleted. [ 648.861570] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.909926] env[65413]: INFO networking_nsxv3.common.synchronization [req-f5e1ad0a-4e45-4228-b9f0-da4088437b90 req-59f891b0-3163-40c7-b30d-1718db28316b service nova] Enqueued Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_rules [ 648.909926] env[65413]: INFO networking_nsxv3.common.synchronization [req-f5e1ad0a-4e45-4228-b9f0-da4088437b90 req-59f891b0-3163-40c7-b30d-1718db28316b service nova] Enqueued Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_members [ 648.909926] env[65413]: INFO networking_nsxv3.common.synchronization [req-f5e1ad0a-4e45-4228-b9f0-da4088437b90 req-59f891b0-3163-40c7-b30d-1718db28316b service nova] Enqueued Resource ID: 23bbbd7d-6e78-4be6-9d98-2f93e429cc26 with Priority: HIGHEST for action port [ 648.909926] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_rules [ 648.909926] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_members [ 648.909926] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23bbbd7d-6e78-4be6-9d98-2f93e429cc26 with Priority: HIGHEST for action port [ 648.910924] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6548500-a35c-4067-ba0a-a6f94326b3ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.911177] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.911340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.911645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.911828] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.912872] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6548500-a35c-4067-ba0a-a6f94326b3ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.913110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.913402] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-23bbbd7d-6e78-4be6-9d98-2f93e429cc26 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.913638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23bbbd7d-6e78-4be6-9d98-2f93e429cc26" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.913791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23bbbd7d-6e78-4be6-9d98-2f93e429cc26" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.915825] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23bbbd7d-6e78-4be6-9d98-2f93e429cc26" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.915825] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23bbbd7d-6e78-4be6-9d98-2f93e429cc26',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.241529] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cd34bb24-11b2-4ccc-9316-b0c847939508 in Status: SUCCESS [ 649.241787] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.419325] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6548500-a35c-4067-ba0a-a6f94326b3ef taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.419443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.419613] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23bbbd7d-6e78-4be6-9d98-2f93e429cc26 with status ACTIVE [ 649.420135] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.420135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.420135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.420374] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.420488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.420752] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.420752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.421075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.421075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.421075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.421432] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.421432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.421605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.421657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.421740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.421892] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23bbbd7d-6e78-4be6-9d98-2f93e429cc26 is going to be updated. [ 649.450295] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.450843] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.450843] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.450991] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.451194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.451922] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23bbbd7d-6e78-4be6-9d98-2f93e429cc26" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.204079] env[65413]: INFO networking_nsxv3.common.synchronization [req-5f7f5d32-d8f9-44d0-9efd-47f5d02b3bfc req-ab618b8c-9eda-4b40-be65-c51fcd735ce9 tempest-ImagesNegativeTestJSON-897306554 tempest-ImagesNegativeTestJSON-897306554-project-member] Enqueued Resource ID: 0a7fc932-3592-4bfb-af13-f30854471e39 with Priority: HIGHEST for action security_group_members [ 650.204547] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7fc932-3592-4bfb-af13-f30854471e39 with Priority: HIGHEST for action security_group_members [ 650.204602] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7fc932-3592-4bfb-af13-f30854471e39 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.204732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.204796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.205162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.205258] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.205330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.205399] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.205542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.205628] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.205738] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7fc932-3592-4bfb-af13-f30854471e39',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.647360] env[65413]: INFO networking_nsxv3.common.synchronization [None req-f61adeb0-12dd-4ed7-a8ab-1594571926b3 None None] Enqueued Resource ID: 77071cf8-6038-495e-8e32-a58c4b616686 with Priority: HIGHEST for action port [ 650.648378] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77071cf8-6038-495e-8e32-a58c4b616686 with Priority: HIGHEST for action port [ 650.648717] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-77071cf8-6038-495e-8e32-a58c4b616686 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.648847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77071cf8-6038-495e-8e32-a58c4b616686" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.649921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77071cf8-6038-495e-8e32-a58c4b616686" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.650415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77071cf8-6038-495e-8e32-a58c4b616686" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.650552] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77071cf8-6038-495e-8e32-a58c4b616686',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.708310] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.708472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.708544] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.708781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.708890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.709147] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.709267] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.709331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.709455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.709704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.709841] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7fc932-3592-4bfb-af13-f30854471e39 already deleted. [ 650.709923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.746510] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6548500-a35c-4067-ba0a-a6f94326b3ef in Status: SUCCESS [ 650.746836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.749181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.749181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.749181] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.749181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.749181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.749181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.749181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.749181] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.035454] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-764 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.035653] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-764" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.036606] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-764" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.036606] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-764" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.036606] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.036606] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.037492] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.037492] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.037677] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.038125] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.038125] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.038125] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.038125] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.038556] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.038556] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.038556] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.060284] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.060497] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 651.060670] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.060847] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-764" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.061194] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-14e14be5-d19b-462e-b61f-9437ceded02b taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.061359] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-14e14be5-d19b-462e-b61f-9437ceded02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.061528] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-14e14be5-d19b-462e-b61f-9437ceded02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.061937] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-14e14be5-d19b-462e-b61f-9437ceded02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.062026] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e14be5-d19b-462e-b61f-9437ceded02b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.154461] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77071cf8-6038-495e-8e32-a58c4b616686 [ 651.154710] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.154881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.154977] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.155207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.155297] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.155392] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77071cf8-6038-495e-8e32-a58c4b616686 already deleted. [ 651.155473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77071cf8-6038-495e-8e32-a58c4b616686" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.250412] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.265951] env[65413]: INFO networking_nsxv3.common.synchronization [None req-caedd957-b2d5-413b-8de4-95984a41dcb7 None None] Enqueued Resource ID: bd622fab-afeb-4e9f-bc6c-53a95aa2ee15 with Priority: HIGHEST for action port [ 651.271542] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd622fab-afeb-4e9f-bc6c-53a95aa2ee15 with Priority: HIGHEST for action port [ 651.272601] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd622fab-afeb-4e9f-bc6c-53a95aa2ee15 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.272742] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd622fab-afeb-4e9f-bc6c-53a95aa2ee15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.272816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd622fab-afeb-4e9f-bc6c-53a95aa2ee15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.273179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd622fab-afeb-4e9f-bc6c-53a95aa2ee15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.273285] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd622fab-afeb-4e9f-bc6c-53a95aa2ee15',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.565219] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.565498] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.565623] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.565897] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.566058] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.566217] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 14e14be5-d19b-462e-b61f-9437ceded02b not found, creating... [ 651.566472] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.566630] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.566742] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.566966] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.567129] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.567410] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.568336] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.568336] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.568336] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.568336] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.568646] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 14e14be5-d19b-462e-b61f-9437ceded02b is going to be created. [ 651.592193] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.592940] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.592940] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.592940] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.594161] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.594161] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-14e14be5-d19b-462e-b61f-9437ceded02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.753532] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.779967] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bd622fab-afeb-4e9f-bc6c-53a95aa2ee15 [ 651.779967] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.779967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.779967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.779967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.779967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.779967] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bd622fab-afeb-4e9f-bc6c-53a95aa2ee15 already deleted. [ 651.780645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd622fab-afeb-4e9f-bc6c-53a95aa2ee15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.262844] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.262844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.262844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.262844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.262844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.262844] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6548500-a35c-4067-ba0a-a6f94326b3ef is going to be updated. [ 652.296111] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.296111] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.296111] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.296111] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.296397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.307260] env[65413]: INFO networking_nsxv3.common.synchronization [req-5f7f5d32-d8f9-44d0-9efd-47f5d02b3bfc req-38bf3515-b10c-431f-bd13-6e9de4bdbf28 service nova] Enqueued Resource ID: 0a7fc932-3592-4bfb-af13-f30854471e39 with Priority: HIGHEST for action security_group_rules [ 652.307260] env[65413]: INFO networking_nsxv3.common.synchronization [req-5f7f5d32-d8f9-44d0-9efd-47f5d02b3bfc req-38bf3515-b10c-431f-bd13-6e9de4bdbf28 service nova] Enqueued Resource ID: 0a7fc932-3592-4bfb-af13-f30854471e39 with Priority: HIGHEST for action security_group_members [ 652.307260] env[65413]: INFO networking_nsxv3.common.synchronization [req-5f7f5d32-d8f9-44d0-9efd-47f5d02b3bfc req-38bf3515-b10c-431f-bd13-6e9de4bdbf28 service nova] Enqueued Resource ID: 14e14be5-d19b-462e-b61f-9437ceded02b with Priority: HIGHEST for action port [ 652.307260] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7fc932-3592-4bfb-af13-f30854471e39 with Priority: HIGHEST for action security_group_rules [ 652.307260] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7fc932-3592-4bfb-af13-f30854471e39 with Priority: HIGHEST for action security_group_members [ 652.307260] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14e14be5-d19b-462e-b61f-9437ceded02b with Priority: HIGHEST for action port [ 652.308305] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6548500-a35c-4067-ba0a-a6f94326b3ef in Status: IN_PROGRESS for 2s [ 652.308570] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a7fc932-3592-4bfb-af13-f30854471e39 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.308702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.308769] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.309214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.309214] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a7fc932-3592-4bfb-af13-f30854471e39',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.310216] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7fc932-3592-4bfb-af13-f30854471e39 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.310334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.310396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.310581] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.310724] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.310814] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.310871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.311023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.311102] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.311194] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7fc932-3592-4bfb-af13-f30854471e39',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.312529] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-14e14be5-d19b-462e-b61f-9437ceded02b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.313669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14e14be5-d19b-462e-b61f-9437ceded02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.313669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14e14be5-d19b-462e-b61f-9437ceded02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.313669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14e14be5-d19b-462e-b61f-9437ceded02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.313669] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14e14be5-d19b-462e-b61f-9437ceded02b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.497036] env[65413]: INFO networking_nsxv3.common.synchronization [None req-cfc8ca7a-fc51-49eb-a0eb-a54ee527fc8f None None] Enqueued Resource ID: aec94784-8d9a-49df-acaf-15aa3c2b4f01 with Priority: HIGHEST for action port [ 652.501207] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aec94784-8d9a-49df-acaf-15aa3c2b4f01 with Priority: HIGHEST for action port [ 652.501207] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-aec94784-8d9a-49df-acaf-15aa3c2b4f01 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.501207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aec94784-8d9a-49df-acaf-15aa3c2b4f01" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.501207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aec94784-8d9a-49df-acaf-15aa3c2b4f01" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.501207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aec94784-8d9a-49df-acaf-15aa3c2b4f01" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.501207] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aec94784-8d9a-49df-acaf-15aa3c2b4f01',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.819449] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0a7fc932-3592-4bfb-af13-f30854471e39',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.819449] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7fc932-3592-4bfb-af13-f30854471e39 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.819449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.819449] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14e14be5-d19b-462e-b61f-9437ceded02b with status ACTIVE [ 652.819449] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.819449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.819449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.819449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.819449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.819449] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.819449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.819449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.819449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.819449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.820872] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.821008] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.821081] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.821656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.821656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.821656] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14e14be5-d19b-462e-b61f-9437ceded02b is going to be updated. [ 652.854371] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.854625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.854625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.854834] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.854967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.855141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14e14be5-d19b-462e-b61f-9437ceded02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.003697] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aec94784-8d9a-49df-acaf-15aa3c2b4f01 [ 653.003697] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.003697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.003697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.003697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.003697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.004567] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aec94784-8d9a-49df-acaf-15aa3c2b4f01 already deleted. [ 653.004567] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aec94784-8d9a-49df-acaf-15aa3c2b4f01" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.113017] env[65413]: INFO networking_nsxv3.common.synchronization [None req-08c770e9-f2ff-446b-b313-69c159fe0616 None None] Enqueued Resource ID: a5f477b0-d454-4d01-a2bb-e89de7835a46 with Priority: HIGHEST for action port [ 653.113901] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5f477b0-d454-4d01-a2bb-e89de7835a46 with Priority: HIGHEST for action port [ 653.114710] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5f477b0-d454-4d01-a2bb-e89de7835a46 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.114887] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5f477b0-d454-4d01-a2bb-e89de7835a46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.115247] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5f477b0-d454-4d01-a2bb-e89de7835a46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.115432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5f477b0-d454-4d01-a2bb-e89de7835a46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.115516] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5f477b0-d454-4d01-a2bb-e89de7835a46',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.324465] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0a7fc932-3592-4bfb-af13-f30854471e39',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.619501] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5f477b0-d454-4d01-a2bb-e89de7835a46 [ 653.620741] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.620741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.620741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.621024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.622071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.622071] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5f477b0-d454-4d01-a2bb-e89de7835a46 already deleted. [ 653.622071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5f477b0-d454-4d01-a2bb-e89de7835a46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.829639] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.829639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.829639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.830016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.830016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.830016] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7fc932-3592-4bfb-af13-f30854471e39 is going to be created. [ 653.868725] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.868725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.868725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.868725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.868725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.881694] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7fc932-3592-4bfb-af13-f30854471e39 in Status: UNINITIALIZED for 2s [ 654.030653] env[65413]: INFO networking_nsxv3.common.synchronization [req-7d0e360f-1ca2-4dfb-a477-d7c6bc6091a5 req-7f0a19e5-66ad-467e-bf2e-be9933cf767f tempest-ServerExternalEventsTest-26964502 tempest-ServerExternalEventsTest-26964502-project-member] Enqueued Resource ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 with Priority: HIGHEST for action security_group_members [ 654.031972] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 with Priority: HIGHEST for action security_group_members [ 654.031972] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.031972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.031972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.031972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.036218] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.036453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.036550] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.036865] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.036973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.040026] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1945c8c9-d5b5-4111-ba8b-cb310537a2d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.337096] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6548500-a35c-4067-ba0a-a6f94326b3ef in Status: SUCCESS [ 654.337451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.337503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.337735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.337937] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.340704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.340809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.341047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.341151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.343031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.343031] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.541434] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.542680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.544558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.544558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.544558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.544558] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.544558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.544558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.544558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.544558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.544558] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 already deleted. [ 654.544558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.556010] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.557024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.557024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.557024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.557231] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.557531] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.557762] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.558102] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.558350] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.558660] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.558873] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.559118] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.560463] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.560463] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.560463] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.560463] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.581031] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.581205] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.581337] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.581578] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.581899] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-4f602a88-ca25-415e-a853-cc21128e5642 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.582079] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-4f602a88-ca25-415e-a853-cc21128e5642" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.582191] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-4f602a88-ca25-415e-a853-cc21128e5642" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.582502] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-4f602a88-ca25-415e-a853-cc21128e5642" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.582632] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f602a88-ca25-415e-a853-cc21128e5642',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.849037] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6548500-a35c-4067-ba0a-a6f94326b3ef taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.849037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.849037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.849037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.849037] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.849037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.849037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.849037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.849548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.849548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.849548] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6548500-a35c-4067-ba0a-a6f94326b3ef taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.849548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.849854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.849854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.850920] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.850920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.850920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.850920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.850920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.850920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.850920] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.087091] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.087091] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.087091] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.087091] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.087091] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.087091] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 4f602a88-ca25-415e-a853-cc21128e5642 not found, creating... [ 655.087091] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.087593] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.087593] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.087718] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.088762] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.088762] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.088762] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.088762] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.089165] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.089165] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.089257] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 4f602a88-ca25-415e-a853-cc21128e5642 is going to be created. [ 655.112767] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.113028] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.113115] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.113407] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.113633] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.113860] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-4f602a88-ca25-415e-a853-cc21128e5642" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.354685] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b6548500-a35c-4067-ba0a-a6f94326b3ef: rpc.has_security_group_logging(os_id): False [ 655.379779] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.380030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.380030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.380251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.380356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.380587] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.380697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.380759] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.380925] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.381020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.381209] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.381415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.381415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.381584] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.382364] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.382762] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.382980] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.383079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.383371] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.383986] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.384160] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6548500-a35c-4067-ba0a-a6f94326b3ef is going to be updated. [ 655.468577] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.468785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.468860] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.469245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.469490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.486039] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6548500-a35c-4067-ba0a-a6f94326b3ef in Status: IN_PROGRESS for 2s [ 655.833759] env[65413]: INFO networking_nsxv3.common.synchronization [None req-dd87a6dd-72a7-49f3-8ed8-56452bac7f91 None None] Enqueued Resource ID: 609f6c57-97cb-4591-86ff-3cde850f1e9f with Priority: HIGHEST for action port [ 655.834543] env[65413]: INFO networking_nsxv3.common.synchronization [None req-39d0998e-69a6-44d3-b5d2-87ab708fe1a5 None None] Enqueued Resource ID: 80f4c6ac-b254-46c6-ac48-e90b31900d04 with Priority: HIGHEST for action port [ 655.840068] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 609f6c57-97cb-4591-86ff-3cde850f1e9f with Priority: HIGHEST for action port [ 655.840421] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 80f4c6ac-b254-46c6-ac48-e90b31900d04 with Priority: HIGHEST for action port [ 655.841158] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-609f6c57-97cb-4591-86ff-3cde850f1e9f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.841305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-609f6c57-97cb-4591-86ff-3cde850f1e9f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.841377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-609f6c57-97cb-4591-86ff-3cde850f1e9f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.841670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-609f6c57-97cb-4591-86ff-3cde850f1e9f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.841757] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('609f6c57-97cb-4591-86ff-3cde850f1e9f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.845692] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-80f4c6ac-b254-46c6-ac48-e90b31900d04 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.846138] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-80f4c6ac-b254-46c6-ac48-e90b31900d04" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.846138] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-80f4c6ac-b254-46c6-ac48-e90b31900d04" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.846311] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-80f4c6ac-b254-46c6-ac48-e90b31900d04" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.846405] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('80f4c6ac-b254-46c6-ac48-e90b31900d04',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.874629] env[65413]: INFO networking_nsxv3.common.synchronization [req-7d0e360f-1ca2-4dfb-a477-d7c6bc6091a5 req-34bfa09a-66fe-4753-8550-0d8fc4832646 service nova] Enqueued Resource ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 with Priority: HIGHEST for action security_group_rules [ 655.874629] env[65413]: INFO networking_nsxv3.common.synchronization [req-7d0e360f-1ca2-4dfb-a477-d7c6bc6091a5 req-34bfa09a-66fe-4753-8550-0d8fc4832646 service nova] Enqueued Resource ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 with Priority: HIGHEST for action security_group_members [ 655.874629] env[65413]: INFO networking_nsxv3.common.synchronization [req-7d0e360f-1ca2-4dfb-a477-d7c6bc6091a5 req-34bfa09a-66fe-4753-8550-0d8fc4832646 service nova] Enqueued Resource ID: 4f602a88-ca25-415e-a853-cc21128e5642 with Priority: HIGHEST for action port [ 655.875092] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 with Priority: HIGHEST for action security_group_rules [ 655.875363] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 with Priority: HIGHEST for action security_group_members [ 655.875363] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f602a88-ca25-415e-a853-cc21128e5642 with Priority: HIGHEST for action port [ 655.876815] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1945c8c9-d5b5-4111-ba8b-cb310537a2d4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.876815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.876815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.876815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.876815] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1945c8c9-d5b5-4111-ba8b-cb310537a2d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.880431] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.880431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.880431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.880431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.880431] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.880431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.880431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.880431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.880431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.880431] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1945c8c9-d5b5-4111-ba8b-cb310537a2d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.880431] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-4f602a88-ca25-415e-a853-cc21128e5642 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.880912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4f602a88-ca25-415e-a853-cc21128e5642" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.880912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4f602a88-ca25-415e-a853-cc21128e5642" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.881907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4f602a88-ca25-415e-a853-cc21128e5642" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.882075] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4f602a88-ca25-415e-a853-cc21128e5642',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.900230] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7fc932-3592-4bfb-af13-f30854471e39 in Status: SUCCESS [ 655.900455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.901186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.901449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.902671] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.902812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.902884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.903093] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.903182] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.903627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.903790] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0a7fc932-3592-4bfb-af13-f30854471e39',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.348823] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 609f6c57-97cb-4591-86ff-3cde850f1e9f [ 656.349322] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.349444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.349519] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.349739] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.349830] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.349926] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:609f6c57-97cb-4591-86ff-3cde850f1e9f already deleted. [ 656.350049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-609f6c57-97cb-4591-86ff-3cde850f1e9f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.350268] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 80f4c6ac-b254-46c6-ac48-e90b31900d04 [ 656.350427] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.350530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.350591] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.350754] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.350831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.350913] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:80f4c6ac-b254-46c6-ac48-e90b31900d04 already deleted. [ 656.350991] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-80f4c6ac-b254-46c6-ac48-e90b31900d04" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.385564] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1945c8c9-d5b5-4111-ba8b-cb310537a2d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.386977] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.387149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.387805] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4f602a88-ca25-415e-a853-cc21128e5642 with status ACTIVE [ 656.388013] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.388189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.388189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.388743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.388743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.388743] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.388743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.389288] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.391112] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.391112] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.391808] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.391808] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.391808] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.392174] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.392294] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.393061] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4f602a88-ca25-415e-a853-cc21128e5642 is going to be updated. [ 656.407038] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7fc932-3592-4bfb-af13-f30854471e39 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.407816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.407959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.408222] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.408417] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.408570] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.408665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.409411] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.409411] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.409411] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.409411] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7fc932-3592-4bfb-af13-f30854471e39 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.410032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.410175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.410433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.410591] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.410723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.410812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.411034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.411152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.411267] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.411386] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0a7fc932-3592-4bfb-af13-f30854471e39',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.420298] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.420298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.420298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.420298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.420298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.420298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4f602a88-ca25-415e-a853-cc21128e5642" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.485697] env[65413]: INFO networking_nsxv3.common.synchronization [req-d7f6a2b9-59d8-487e-a743-ad3c90cb7581 req-74a01372-3a12-40ee-8c2f-abdd9e210e5a tempest-ServerDiagnosticsTest-346665145 tempest-ServerDiagnosticsTest-346665145-project-member] Enqueued Resource ID: 14ffed21-0b3b-46f2-aece-160a014b9767 with Priority: HIGHEST for action security_group_members [ 656.487483] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ffed21-0b3b-46f2-aece-160a014b9767 with Priority: HIGHEST for action security_group_members [ 656.487483] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ffed21-0b3b-46f2-aece-160a014b9767 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.487483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.487483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.487747] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.488012] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.488143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.488204] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.488508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.488508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.488655] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14ffed21-0b3b-46f2-aece-160a014b9767',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.889199] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1945c8c9-d5b5-4111-ba8b-cb310537a2d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.913912] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0a7fc932-3592-4bfb-af13-f30854471e39: rpc.has_security_group_logging(os_id): False [ 656.938651] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.938651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.938651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.939141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.939141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.939141] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.939141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.939408] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.939408] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.939511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.942224] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.942224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.942224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.942224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.942224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.942224] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.942224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.942224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.942224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.942224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.942224] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a7fc932-3592-4bfb-af13-f30854471e39 is going to be created. [ 656.991795] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.995022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.995022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.995022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.995022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.995022] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.995022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.995022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.995022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.995022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.995022] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ffed21-0b3b-46f2-aece-160a014b9767 is going to be updated. [ 657.016074] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.016074] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.016074] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.016074] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.016074] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.032905] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7fc932-3592-4bfb-af13-f30854471e39 in Status: IN_PROGRESS for 2s [ 657.037595] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.037595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.037595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.037595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.037595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.047472] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ffed21-0b3b-46f2-aece-160a014b9767 in Status: IN_PROGRESS for 2s [ 657.392606] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.392606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.392606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.392606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.392606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.392606] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 is going to be created. [ 657.420874] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.420874] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.420874] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.420874] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.421174] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.432965] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 in Status: UNINITIALIZED for 2s [ 657.476246] env[65413]: INFO networking_nsxv3.common.synchronization [req-cd2ce3e9-2190-47fe-9f92-0de176f4aa78 req-06ae0543-25f2-4c5f-89c1-adbad6715167 tempest-ServersAdminTestJSON-1071948959 tempest-ServersAdminTestJSON-1071948959-project-member] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 657.476246] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 657.476246] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.476246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.476246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.477580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.477580] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.477580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.477580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.477580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.477580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.477580] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.502885] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b6548500-a35c-4067-ba0a-a6f94326b3ef in Status: SUCCESS [ 657.503329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.980664] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.103024] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-743 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.103024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.103024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.103024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.103024] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.103024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.103024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.103024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.103024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.103024] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.103024] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 658.103024] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 658.103643] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 658.103643] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 658.103643] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 658.103643] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 658.125965] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 658.126392] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 658.126392] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 658.126564] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.126824] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-2c288ca0-c885-4555-a9e9-0ced65af2299 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.127146] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-2c288ca0-c885-4555-a9e9-0ced65af2299" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.127396] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-2c288ca0-c885-4555-a9e9-0ced65af2299" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.127791] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-2c288ca0-c885-4555-a9e9-0ced65af2299" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.127936] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c288ca0-c885-4555-a9e9-0ced65af2299',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.483227] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.631646] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.632039] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.632165] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.632433] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.632581] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.632734] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 2c288ca0-c885-4555-a9e9-0ced65af2299 not found, creating... [ 658.632999] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.633178] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.633288] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.633604] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.633756] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.635340] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.635340] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.635340] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.635340] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.635340] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.635340] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 2c288ca0-c885-4555-a9e9-0ced65af2299 is going to be created. [ 658.657662] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.658414] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.658414] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.658570] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.658798] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.658989] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-2c288ca0-c885-4555-a9e9-0ced65af2299" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.985927] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.986094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.986094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.986404] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.986541] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.986654] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be updated. [ 659.021089] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.021310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.021663] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.021663] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.021850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.032813] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: IN_PROGRESS for 2s [ 659.047441] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0a7fc932-3592-4bfb-af13-f30854471e39 in Status: SUCCESS [ 659.048234] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.066079] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ffed21-0b3b-46f2-aece-160a014b9767 in Status: SUCCESS [ 659.066261] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ffed21-0b3b-46f2-aece-160a014b9767 deletion is rescheduled due to dependency. [ 659.066388] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ffed21-0b3b-46f2-aece-160a014b9767" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.412021] env[65413]: INFO networking_nsxv3.common.synchronization [req-cd2ce3e9-2190-47fe-9f92-0de176f4aa78 req-702e0d8f-d234-471b-bc65-62048aa34646 service nova] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_rules [ 659.412021] env[65413]: INFO networking_nsxv3.common.synchronization [req-cd2ce3e9-2190-47fe-9f92-0de176f4aa78 req-702e0d8f-d234-471b-bc65-62048aa34646 service nova] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 659.412021] env[65413]: INFO networking_nsxv3.common.synchronization [req-cd2ce3e9-2190-47fe-9f92-0de176f4aa78 req-702e0d8f-d234-471b-bc65-62048aa34646 service nova] Enqueued Resource ID: 2c288ca0-c885-4555-a9e9-0ced65af2299 with Priority: HIGHEST for action port [ 659.412553] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_rules [ 659.413074] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 659.413944] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c288ca0-c885-4555-a9e9-0ced65af2299 with Priority: HIGHEST for action port [ 659.413944] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.413944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.413944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.414194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.414194] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.415463] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.416478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.416478] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c288ca0-c885-4555-a9e9-0ced65af2299 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.416478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c288ca0-c885-4555-a9e9-0ced65af2299" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.416478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c288ca0-c885-4555-a9e9-0ced65af2299" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.416478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c288ca0-c885-4555-a9e9-0ced65af2299" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.416478] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c288ca0-c885-4555-a9e9-0ced65af2299',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.444867] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 in Status: SUCCESS [ 659.445137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.445781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.445781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.445991] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.446104] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.446197] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.446404] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.446517] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.446634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.446750] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1945c8c9-d5b5-4111-ba8b-cb310537a2d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.919435] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.919435] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.919435] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c288ca0-c885-4555-a9e9-0ced65af2299 with status ACTIVE [ 659.919435] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.919873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.919873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.920453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.921968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.921968] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.921968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.921968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.921968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.921968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.921968] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.921968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.921968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.921968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.921968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.921968] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c288ca0-c885-4555-a9e9-0ced65af2299 is going to be updated. [ 659.947443] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.947655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.947758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.948110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.948307] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.948540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c288ca0-c885-4555-a9e9-0ced65af2299" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.948919] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.949137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.949255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.949468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.949667] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.949797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.949907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.950114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.950256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.950382] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.950558] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.950730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.950730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.951083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.951271] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.951410] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.951509] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.951681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.951803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.951927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.952069] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1945c8c9-d5b5-4111-ba8b-cb310537a2d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.218488] env[65413]: INFO networking_nsxv3.common.synchronization [None req-2ba6a785-bb7b-4c2e-9950-acfb68ace3a0 None None] Enqueued Resource ID: 398f04b9-62ca-43cc-b8df-ad2a87f1ad2f with Priority: HIGHEST for action port [ 660.220736] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 398f04b9-62ca-43cc-b8df-ad2a87f1ad2f with Priority: HIGHEST for action port [ 660.220736] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-398f04b9-62ca-43cc-b8df-ad2a87f1ad2f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.220736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-398f04b9-62ca-43cc-b8df-ad2a87f1ad2f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.220736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-398f04b9-62ca-43cc-b8df-ad2a87f1ad2f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.220736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-398f04b9-62ca-43cc-b8df-ad2a87f1ad2f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.221133] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('398f04b9-62ca-43cc-b8df-ad2a87f1ad2f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.454865] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1945c8c9-d5b5-4111-ba8b-cb310537a2d4: rpc.has_security_group_logging(os_id): False [ 660.474192] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.474384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.474384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.474602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.475461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.475461] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.475461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.475461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.475461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.475461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.475777] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.475777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.475777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.475777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.475914] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.477024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.477024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.477178] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.477240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.477328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.477419] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 is going to be created. [ 660.542208] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.542478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.542478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.542736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.542956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.557808] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 in Status: IN_PROGRESS for 2s [ 660.723060] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 398f04b9-62ca-43cc-b8df-ad2a87f1ad2f [ 660.723323] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.723574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.723574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.723801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.723927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.724039] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:398f04b9-62ca-43cc-b8df-ad2a87f1ad2f already deleted. [ 660.724109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-398f04b9-62ca-43cc-b8df-ad2a87f1ad2f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.048218] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 661.050963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.050963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.050963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.050963] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.050963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.050963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.050963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.051899] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.052117] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.555163] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.058310] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.561651] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.561651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.561651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.561651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.561651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.561651] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be updated. [ 662.578500] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 in Status: SUCCESS [ 662.578724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.603855] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.603855] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.603855] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.603855] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.603855] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.617425] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: IN_PROGRESS for 2s [ 664.631175] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 664.631529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.631617] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.631800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.632277] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.632277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.632277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.632602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.632602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.632602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.632602] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.138024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.138024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.138024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.138024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.138024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.138024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.138024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.138024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.138024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.138024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.138024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.138024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.138024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.138024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.138024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.138024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.138766] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.138766] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.138766] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.138766] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.138766] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.170131] env[65413]: INFO networking_nsxv3.common.synchronization [req-821ef708-6fef-4655-9f1c-66c7b91fdf5f req-72c91dbd-fe3e-46c4-9563-71aebc02d8f2 tempest-DeleteServersAdminTestJSON-65358818 tempest-DeleteServersAdminTestJSON-65358818-project-member] Enqueued Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_members [ 665.170732] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGHEST for action security_group_members [ 665.171266] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58d03374-02a8-4013-ba8d-fa57c3795178 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.171494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.171582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.172308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.172513] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.172660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.172732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.172941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.173054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.173151] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.641808] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69363ac6-cdf1-4edb-9d06-998638037b3e: rpc.has_security_group_logging(os_id): False [ 665.663593] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.663593] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.663593] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.663898] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.663978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.664233] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.664361] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.664442] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.664582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.664660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.664905] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.665194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.665194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.665320] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.665320] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.665455] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.665551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.665601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.665737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.665812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.665980] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be updated. [ 665.677492] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.677798] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.677933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.678327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.678471] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.678801] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.679044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.679106] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.679406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.679527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.679663] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d03374-02a8-4013-ba8d-fa57c3795178 is going to be updated. [ 665.758547] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.758547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.758547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.758975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.758975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.773950] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d03374-02a8-4013-ba8d-fa57c3795178 in Status: IN_PROGRESS for 2s [ 665.807657] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.807894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.807894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.808275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.808521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.834232] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: IN_PROGRESS for 2s [ 667.214714] env[65413]: INFO networking_nsxv3.common.synchronization [req-6b5fce99-533e-4013-9ed3-faeeaf6b34c8 req-aa1754a2-de32-45d7-ab9a-aef9f2415478 tempest-ServerRescueTestJSONUnderV235-958519432 tempest-ServerRescueTestJSONUnderV235-958519432-project-member] Enqueued Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_members [ 667.215122] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_members [ 667.215423] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.215574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.215630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.215867] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.216040] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.216144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.216484] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.216484] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.216484] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.216693] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.597212] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.597434] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-449" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.597573] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-449" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.597889] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-449" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.598200] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.598373] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.598484] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.598715] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.598852] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.599069] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 667.599486] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 667.599644] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 667.599754] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 667.599863] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 667.599972] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 667.600117] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 667.625512] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 667.625792] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 667.625946] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 667.626154] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-449" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.626482] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-07516081-95d5-411b-9914-1f658ec348e5 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.626737] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.626737] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.627420] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.627676] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07516081-95d5-411b-9914-1f658ec348e5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.718676] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.718844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.718922] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.719271] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.719402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.719653] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.719789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.719875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.720090] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.720214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.720321] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 already deleted. [ 667.720402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.785014] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58d03374-02a8-4013-ba8d-fa57c3795178 in Status: SUCCESS [ 667.785228] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58d03374-02a8-4013-ba8d-fa57c3795178 deletion is rescheduled due to dependency. [ 667.785228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.866656] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 667.868837] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.064461] env[65413]: INFO networking_nsxv3.common.synchronization [req-b104c073-56c3-4772-8231-889583536666 req-ce7196c9-51ca-4df2-a29c-97ff590d37a8 tempest-ImagesNegativeTestJSON-897306554 tempest-ImagesNegativeTestJSON-897306554-project-member] Enqueued Resource ID: 0a7fc932-3592-4bfb-af13-f30854471e39 with Priority: HIGHEST for action security_group_members [ 668.065205] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7fc932-3592-4bfb-af13-f30854471e39 with Priority: HIGHEST for action security_group_members [ 668.065589] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0a7fc932-3592-4bfb-af13-f30854471e39 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.065722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.065722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.066462] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.066629] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.066736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.066796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.066966] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.067069] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.067212] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0a7fc932-3592-4bfb-af13-f30854471e39',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.130715] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.130975] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.131151] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.131515] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.131700] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.131849] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 07516081-95d5-411b-9914-1f658ec348e5 not found, creating... [ 668.132135] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.132352] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.132469] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.132691] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.132815] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.133106] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.133256] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.133364] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.133579] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.133728] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.133888] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 07516081-95d5-411b-9914-1f658ec348e5 is going to be created. [ 668.160752] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.160974] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.161131] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.161441] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.161754] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.162016] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.570962] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.570962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.570962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.570962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.570962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.570962] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.570962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.570962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.570962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.570962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.570962] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7fc932-3592-4bfb-af13-f30854471e39 is going to be updated. [ 668.612102] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.612314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.612432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.612788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.613040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.626393] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7fc932-3592-4bfb-af13-f30854471e39 in Status: IN_PROGRESS for 2s [ 668.998644] env[65413]: INFO networking_nsxv3.common.synchronization [req-6b5fce99-533e-4013-9ed3-faeeaf6b34c8 req-46188d89-5318-4779-9b07-fb7155fe78a3 service nova] Enqueued Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_rules [ 668.998955] env[65413]: INFO networking_nsxv3.common.synchronization [req-6b5fce99-533e-4013-9ed3-faeeaf6b34c8 req-46188d89-5318-4779-9b07-fb7155fe78a3 service nova] Enqueued Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_members [ 669.005684] env[65413]: INFO networking_nsxv3.common.synchronization [req-6b5fce99-533e-4013-9ed3-faeeaf6b34c8 req-46188d89-5318-4779-9b07-fb7155fe78a3 service nova] Enqueued Resource ID: 07516081-95d5-411b-9914-1f658ec348e5 with Priority: HIGHEST for action port [ 669.005684] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_rules [ 669.005684] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_members [ 669.005684] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07516081-95d5-411b-9914-1f658ec348e5 with Priority: HIGHEST for action port [ 669.005684] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.005684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.005684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.005684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.005684] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.006903] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.007027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.007107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.007846] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.008112] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.008257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.008623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.008698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.008768] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.008893] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.010065] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-07516081-95d5-411b-9914-1f658ec348e5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.010531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.010531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.011457] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.011457] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07516081-95d5-411b-9914-1f658ec348e5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.513742] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.515042] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.515042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.515244] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07516081-95d5-411b-9914-1f658ec348e5 with status ACTIVE [ 669.515244] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.515353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.515540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.515675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.515724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.516479] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.516479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.516479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.516479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.516479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.516479] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.516479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.517591] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.517591] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.517591] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.517591] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07516081-95d5-411b-9914-1f658ec348e5 is going to be updated. [ 669.543389] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.543568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.543702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.544480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.544914] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.544914] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.018650] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.523206] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.523206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.523206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.523206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.524113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.524113] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 is going to be created. [ 670.551335] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.551490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.551658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.552050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.552985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.571049] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: UNINITIALIZED for 2s [ 670.639564] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0a7fc932-3592-4bfb-af13-f30854471e39 in Status: SUCCESS [ 670.639846] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0a7fc932-3592-4bfb-af13-f30854471e39 deletion is rescheduled due to dependency. [ 670.640024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.116905] env[65413]: INFO networking_nsxv3.common.synchronization [None req-f2d8ce7a-17df-41a8-b094-ed5d8588f157 None None] Enqueued Resource ID: 9730d862-3676-4c16-b705-ffc695524dff with Priority: HIGHEST for action port [ 671.119049] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9730d862-3676-4c16-b705-ffc695524dff with Priority: HIGHEST for action port [ 671.119049] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-9730d862-3676-4c16-b705-ffc695524dff taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.119049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9730d862-3676-4c16-b705-ffc695524dff" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.119049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9730d862-3676-4c16-b705-ffc695524dff" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.119049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9730d862-3676-4c16-b705-ffc695524dff" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.119049] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9730d862-3676-4c16-b705-ffc695524dff',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.621826] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9730d862-3676-4c16-b705-ffc695524dff [ 671.624365] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.624796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.624796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.624948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.624948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.625069] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9730d862-3676-4c16-b705-ffc695524dff already deleted. [ 671.625373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9730d862-3676-4c16-b705-ffc695524dff" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.583224] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: SUCCESS [ 672.583557] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.583676] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.583905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.584123] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.585230] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.585230] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.585230] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.585230] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.585230] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.585230] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.091873] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.091873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.091873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.091873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.091873] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.091873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.091873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.091873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.091873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.091873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.091873] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.091873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.091873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.091873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.091873] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.091873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.092796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.092796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.092796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.092796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.092796] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.203252] env[65413]: INFO networking_nsxv3.common.synchronization [None req-20b81630-7f04-4d86-a76b-6a7b3ada76d1 None None] Enqueued Resource ID: a5c0bac5-ad0d-4de9-87d2-c87bdf48d1bd with Priority: HIGHEST for action port [ 673.204478] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5c0bac5-ad0d-4de9-87d2-c87bdf48d1bd with Priority: HIGHEST for action port [ 673.210287] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5c0bac5-ad0d-4de9-87d2-c87bdf48d1bd taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.210287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5c0bac5-ad0d-4de9-87d2-c87bdf48d1bd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.210287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5c0bac5-ad0d-4de9-87d2-c87bdf48d1bd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.210287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5c0bac5-ad0d-4de9-87d2-c87bdf48d1bd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.210287] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5c0bac5-ad0d-4de9-87d2-c87bdf48d1bd',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.595839] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b3bad9e-4f10-4e75-bf3f-69836f779f28: rpc.has_security_group_logging(os_id): False [ 673.615768] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.615988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.615988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.616242] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.616335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.616542] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.616675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.616721] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.616870] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.616944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.617188] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.617287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.617338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.617463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.617538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.617735] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.619033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.619033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.619033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.619033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.619033] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 is going to be created. [ 673.697629] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.697629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.697629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.697629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.697629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.712663] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a5c0bac5-ad0d-4de9-87d2-c87bdf48d1bd [ 673.712842] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.712924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.712993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.713331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.713331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.713459] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a5c0bac5-ad0d-4de9-87d2-c87bdf48d1bd already deleted. [ 673.713521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5c0bac5-ad0d-4de9-87d2-c87bdf48d1bd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.716803] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: IN_PROGRESS for 2s [ 673.766700] env[65413]: INFO networking_nsxv3.common.synchronization [req-9eb2522e-965d-4724-823b-72a0dac887b0 req-e53251cc-f59d-462a-9498-997e9aa09185 tempest-ServerExternalEventsTest-26964502 tempest-ServerExternalEventsTest-26964502-project-member] Enqueued Resource ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 with Priority: HIGHEST for action security_group_members [ 673.767441] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 with Priority: HIGHEST for action security_group_members [ 673.767833] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.767971] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.768566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.768871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.769124] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.769407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.769516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.769694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.769817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.769950] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1945c8c9-d5b5-4111-ba8b-cb310537a2d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.277048] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.277048] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.277308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.277437] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.277569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.277906] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.278087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.278087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.282336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.282513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.282649] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 is going to be updated. [ 674.332218] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.332475] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.332475] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.332782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.334827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.354781] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 in Status: IN_PROGRESS for 2s [ 674.595586] env[65413]: INFO networking_nsxv3.common.synchronization [None req-8480e8fd-4e5c-4277-bb2f-baf2731d107a None None] Enqueued Resource ID: f76ac428-c2f1-426f-a13a-e2f5e2a6e57a with Priority: HIGHEST for action port [ 674.595586] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76ac428-c2f1-426f-a13a-e2f5e2a6e57a with Priority: HIGHEST for action port [ 674.595586] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-f76ac428-c2f1-426f-a13a-e2f5e2a6e57a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.595586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f76ac428-c2f1-426f-a13a-e2f5e2a6e57a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.595586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f76ac428-c2f1-426f-a13a-e2f5e2a6e57a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.595586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f76ac428-c2f1-426f-a13a-e2f5e2a6e57a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.595586] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f76ac428-c2f1-426f-a13a-e2f5e2a6e57a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.797025] env[65413]: INFO networking_nsxv3.common.synchronization [req-3126d539-d923-428e-bd04-f64aa3e85e2b req-1293ba3f-b063-410f-9444-cd27e0e98b17 tempest-ServerRescueTestJSON-745679716 tempest-ServerRescueTestJSON-745679716-project-member] Enqueued Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_members [ 674.797025] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_members [ 674.797025] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42ae76b-69ae-499f-b565-4ede857c249b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.797025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.797025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.797025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.797025] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.797025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.797025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.797025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.797025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.797025] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.101582] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f76ac428-c2f1-426f-a13a-e2f5e2a6e57a [ 675.101582] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.101582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.101582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.101582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.101582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.101582] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f76ac428-c2f1-426f-a13a-e2f5e2a6e57a already deleted. [ 675.101582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f76ac428-c2f1-426f-a13a-e2f5e2a6e57a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.243282] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.243526] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-670" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.243709] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-670" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.243983] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-670" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.244787] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.245043] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.245246] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.245554] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.245751] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.246071] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.246242] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 675.246394] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 675.246561] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 675.246730] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 675.246924] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 675.247118] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 675.273219] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 675.273493] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 675.273711] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 675.273930] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-670" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.274283] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-65b300c5-340d-40fc-bc2f-3bab7243fc80 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.274469] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-65b300c5-340d-40fc-bc2f-3bab7243fc80" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.274596] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-65b300c5-340d-40fc-bc2f-3bab7243fc80" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.274942] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-65b300c5-340d-40fc-bc2f-3bab7243fc80" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.275116] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65b300c5-340d-40fc-bc2f-3bab7243fc80',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.300101] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.749812] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: SUCCESS [ 675.749812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.781025] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.781025] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.781025] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.781025] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.781025] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.781025] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 65b300c5-340d-40fc-bc2f-3bab7243fc80 not found, creating... [ 675.781025] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.781025] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.781025] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.781025] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.781025] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.781864] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.781864] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.781864] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.782245] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.782522] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.782790] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 65b300c5-340d-40fc-bc2f-3bab7243fc80 is going to be created. [ 675.803031] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.815066] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.815066] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.815066] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.815066] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.815680] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.815763] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-65b300c5-340d-40fc-bc2f-3bab7243fc80" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.298900] env[65413]: INFO networking_nsxv3.common.synchronization [None req-04f50ad6-b8a8-44e7-b353-dbe5e2d323b3 None None] Enqueued Resource ID: 4e3ddd1b-b4f9-4400-b5db-356a9030bec2 with Priority: HIGHEST for action port [ 676.299156] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e3ddd1b-b4f9-4400-b5db-356a9030bec2 with Priority: HIGHEST for action port [ 676.299836] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e3ddd1b-b4f9-4400-b5db-356a9030bec2 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.299964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e3ddd1b-b4f9-4400-b5db-356a9030bec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.302609] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e3ddd1b-b4f9-4400-b5db-356a9030bec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.303071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e3ddd1b-b4f9-4400-b5db-356a9030bec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.303751] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e3ddd1b-b4f9-4400-b5db-356a9030bec2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.305920] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.306130] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.306247] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.306506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.306651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.306790] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c42ae76b-69ae-499f-b565-4ede857c249b is going to be updated. [ 676.343156] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.343334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.343613] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.343904] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.344122] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.355579] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c42ae76b-69ae-499f-b565-4ede857c249b in Status: IN_PROGRESS for 2s [ 676.363796] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 in Status: SUCCESS [ 676.364113] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1945c8c9-d5b5-4111-ba8b-cb310537a2d4 deletion is rescheduled due to dependency. [ 676.364206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1945c8c9-d5b5-4111-ba8b-cb310537a2d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.570457] env[65413]: INFO networking_nsxv3.common.synchronization [req-3126d539-d923-428e-bd04-f64aa3e85e2b req-d2643acf-6511-4ba8-97d7-33a12c926578 service nova] Enqueued Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_rules [ 676.570915] env[65413]: INFO networking_nsxv3.common.synchronization [req-3126d539-d923-428e-bd04-f64aa3e85e2b req-d2643acf-6511-4ba8-97d7-33a12c926578 service nova] Enqueued Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_members [ 676.570915] env[65413]: INFO networking_nsxv3.common.synchronization [req-3126d539-d923-428e-bd04-f64aa3e85e2b req-d2643acf-6511-4ba8-97d7-33a12c926578 service nova] Enqueued Resource ID: 65b300c5-340d-40fc-bc2f-3bab7243fc80 with Priority: HIGHEST for action port [ 676.571513] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_rules [ 676.571704] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_members [ 676.571850] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65b300c5-340d-40fc-bc2f-3bab7243fc80 with Priority: HIGHEST for action port [ 676.572143] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c42ae76b-69ae-499f-b565-4ede857c249b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.572286] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.572381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.572554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.572631] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.574097] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42ae76b-69ae-499f-b565-4ede857c249b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.574407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.574560] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-65b300c5-340d-40fc-bc2f-3bab7243fc80 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.574722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65b300c5-340d-40fc-bc2f-3bab7243fc80" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.574770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65b300c5-340d-40fc-bc2f-3bab7243fc80" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.574986] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65b300c5-340d-40fc-bc2f-3bab7243fc80" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.575137] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65b300c5-340d-40fc-bc2f-3bab7243fc80',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.806992] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4e3ddd1b-b4f9-4400-b5db-356a9030bec2 [ 676.807451] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.807569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.807681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.808105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.808213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.808337] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4e3ddd1b-b4f9-4400-b5db-356a9030bec2 already deleted. [ 676.808512] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e3ddd1b-b4f9-4400-b5db-356a9030bec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.074581] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42ae76b-69ae-499f-b565-4ede857c249b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.074813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.077310] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65b300c5-340d-40fc-bc2f-3bab7243fc80 with status ACTIVE [ 677.077558] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.077697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.077762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.078050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.078146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.078354] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.078491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.078647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.078647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.078855] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.078915] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.079011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.079150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.079393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.079393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.079624] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65b300c5-340d-40fc-bc2f-3bab7243fc80 is going to be updated. [ 677.103100] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.103281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.103330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.103675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.103799] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.104101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65b300c5-340d-40fc-bc2f-3bab7243fc80" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.769831] env[65413]: INFO networking_nsxv3.common.synchronization [None req-34004bde-84f3-47b8-b4bb-89c4bf9d0b1e None None] Enqueued Resource ID: 644394c7-d8c8-4b82-87d2-877b14891dde with Priority: HIGHEST for action port [ 677.770627] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 644394c7-d8c8-4b82-87d2-877b14891dde with Priority: HIGHEST for action port [ 677.770900] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-644394c7-d8c8-4b82-87d2-877b14891dde taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.770993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-644394c7-d8c8-4b82-87d2-877b14891dde" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.771047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-644394c7-d8c8-4b82-87d2-877b14891dde" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.771324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-644394c7-d8c8-4b82-87d2-877b14891dde" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.771406] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('644394c7-d8c8-4b82-87d2-877b14891dde',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.275420] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 644394c7-d8c8-4b82-87d2-877b14891dde [ 678.275420] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.275420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.275420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.275420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.276054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.276054] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:644394c7-d8c8-4b82-87d2-877b14891dde already deleted. [ 678.276054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-644394c7-d8c8-4b82-87d2-877b14891dde" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.367602] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c42ae76b-69ae-499f-b565-4ede857c249b in Status: SUCCESS [ 678.367838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.368023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.368265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.368450] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.368571] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.368625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.368779] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.368862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.368961] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.871586] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.357953] env[65413]: INFO networking_nsxv3.common.synchronization [req-8feb0e4c-6655-4a8f-b977-a85c687253c2 req-29c46b8c-6fb8-41fb-9dbe-7bf223563948 tempest-ServersTestManualDisk-948107972 tempest-ServersTestManualDisk-948107972-project-member] Enqueued Resource ID: 832015c1-81fd-4bf2-88c3-58e97531a611 with Priority: HIGHEST for action security_group_members [ 679.358525] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832015c1-81fd-4bf2-88c3-58e97531a611 with Priority: HIGHEST for action security_group_members [ 679.358841] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-832015c1-81fd-4bf2-88c3-58e97531a611 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.358970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.359051] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.359356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.359521] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.359658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.359726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.359927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.360048] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.360163] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('832015c1-81fd-4bf2-88c3-58e97531a611',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.373637] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.681402] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-798 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.681628] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-798" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.681743] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-798" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.682179] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-798" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.682535] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.682746] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.682903] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.683966] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.683966] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.683966] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.683966] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.683966] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.683966] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.683966] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.684696] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.684696] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.704929] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.705246] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 679.705396] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.705616] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-798" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.706026] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-79f77ed5-4f61-459b-a791-212c1a289be8 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.706241] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-79f77ed5-4f61-459b-a791-212c1a289be8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.706397] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-79f77ed5-4f61-459b-a791-212c1a289be8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.706793] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-79f77ed5-4f61-459b-a791-212c1a289be8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.706956] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79f77ed5-4f61-459b-a791-212c1a289be8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.863396] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.863396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.863396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.863396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.863396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.863396] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.863396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.863707] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.863707] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.863707] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.863824] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 832015c1-81fd-4bf2-88c3-58e97531a611 already deleted. [ 679.863824] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.876048] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.876259] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.876259] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.876462] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.876534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.876641] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c42ae76b-69ae-499f-b565-4ede857c249b is going to be updated. [ 679.912260] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.912440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.912523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.912803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.912892] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.927687] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c42ae76b-69ae-499f-b565-4ede857c249b in Status: IN_PROGRESS for 2s [ 680.201343] env[65413]: INFO networking_nsxv3.common.synchronization [None req-2dcaf29f-1f88-46c3-84fd-ade6a1401697 None None] Enqueued Resource ID: b26ac618-fe7f-48d4-9c5e-2527b95e5aab with Priority: HIGHEST for action port [ 680.202207] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b26ac618-fe7f-48d4-9c5e-2527b95e5aab with Priority: HIGHEST for action port [ 680.202584] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-b26ac618-fe7f-48d4-9c5e-2527b95e5aab taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.202735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b26ac618-fe7f-48d4-9c5e-2527b95e5aab" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.202803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b26ac618-fe7f-48d4-9c5e-2527b95e5aab" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.203082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b26ac618-fe7f-48d4-9c5e-2527b95e5aab" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.203180] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b26ac618-fe7f-48d4-9c5e-2527b95e5aab',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.210274] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.210274] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.210609] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.210717] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.210877] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.211046] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 79f77ed5-4f61-459b-a791-212c1a289be8 not found, creating... [ 680.211349] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.211554] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.211699] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.212281] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.212427] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.212931] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.212931] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.213101] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.213236] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.213388] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.213555] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 79f77ed5-4f61-459b-a791-212c1a289be8 is going to be created. [ 680.256410] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.256680] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.256819] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.257181] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.257471] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.257779] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-79f77ed5-4f61-459b-a791-212c1a289be8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.705826] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b26ac618-fe7f-48d4-9c5e-2527b95e5aab [ 680.706506] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.706506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.706506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.706832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.706832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.706970] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b26ac618-fe7f-48d4-9c5e-2527b95e5aab already deleted. [ 680.707067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b26ac618-fe7f-48d4-9c5e-2527b95e5aab" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.038927] env[65413]: INFO networking_nsxv3.common.synchronization [req-8feb0e4c-6655-4a8f-b977-a85c687253c2 req-501193fe-0f36-428d-9ce5-41bca7f941cd service nova] Enqueued Resource ID: 832015c1-81fd-4bf2-88c3-58e97531a611 with Priority: HIGHEST for action security_group_rules [ 681.039040] env[65413]: INFO networking_nsxv3.common.synchronization [req-8feb0e4c-6655-4a8f-b977-a85c687253c2 req-501193fe-0f36-428d-9ce5-41bca7f941cd service nova] Enqueued Resource ID: 832015c1-81fd-4bf2-88c3-58e97531a611 with Priority: HIGHEST for action security_group_members [ 681.039105] env[65413]: INFO networking_nsxv3.common.synchronization [req-8feb0e4c-6655-4a8f-b977-a85c687253c2 req-501193fe-0f36-428d-9ce5-41bca7f941cd service nova] Enqueued Resource ID: 79f77ed5-4f61-459b-a791-212c1a289be8 with Priority: HIGHEST for action port [ 681.039754] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832015c1-81fd-4bf2-88c3-58e97531a611 with Priority: HIGHEST for action security_group_rules [ 681.039887] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832015c1-81fd-4bf2-88c3-58e97531a611 with Priority: HIGHEST for action security_group_members [ 681.040106] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79f77ed5-4f61-459b-a791-212c1a289be8 with Priority: HIGHEST for action port [ 681.040808] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-832015c1-81fd-4bf2-88c3-58e97531a611 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.040808] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.040808] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.040808] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.040808] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('832015c1-81fd-4bf2-88c3-58e97531a611',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.042530] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-832015c1-81fd-4bf2-88c3-58e97531a611 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.042530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.042530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.042789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.042992] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.043125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.043434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.043434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.043555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.043608] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('832015c1-81fd-4bf2-88c3-58e97531a611',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.044668] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-79f77ed5-4f61-459b-a791-212c1a289be8 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.044847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79f77ed5-4f61-459b-a791-212c1a289be8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.044847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79f77ed5-4f61-459b-a791-212c1a289be8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.044953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79f77ed5-4f61-459b-a791-212c1a289be8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.045049] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79f77ed5-4f61-459b-a791-212c1a289be8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.546802] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-832015c1-81fd-4bf2-88c3-58e97531a611 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.546972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.547170] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('832015c1-81fd-4bf2-88c3-58e97531a611',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.548291] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79f77ed5-4f61-459b-a791-212c1a289be8 with status ACTIVE [ 681.548385] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.548456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.548585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.548758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.549047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.549231] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.549231] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.549231] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.549458] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.549496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.549737] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.549861] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.549861] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.550038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.550082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.550162] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79f77ed5-4f61-459b-a791-212c1a289be8 is going to be updated. [ 681.579979] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.580180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.580256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.580529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.580646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.580818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79f77ed5-4f61-459b-a791-212c1a289be8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.826098] env[65413]: INFO networking_nsxv3.common.synchronization [req-4f6d0c7a-1fe3-4b30-833b-10db08239305 req-46fd7d1f-d07d-4383-a2cf-9c08d4d4a6ee tempest-VolumesAdminNegativeTest-976716430 tempest-VolumesAdminNegativeTest-976716430-project-member] Enqueued Resource ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 with Priority: HIGHEST for action security_group_members [ 681.826588] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 with Priority: HIGHEST for action security_group_members [ 681.827507] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.827507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.827507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.828606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.828606] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.829785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.830219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.830767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.830767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.830767] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.937772] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c42ae76b-69ae-499f-b565-4ede857c249b in Status: SUCCESS [ 681.937981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.938166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.939183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.939444] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.939574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.939641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.939828] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.939919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.940016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.940113] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.051883] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('832015c1-81fd-4bf2-88c3-58e97531a611',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.314687] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-529 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.317737] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-529" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.317737] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-529" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.317737] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-529" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.317737] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.317737] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.317737] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.317737] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.317737] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.317737] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.317737] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.317737] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.317737] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.317737] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.318436] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.318436] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.334576] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.334576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.334576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.334576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.334576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.334576] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.334576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.334576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.335018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.335018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.335018] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 already deleted. [ 682.335018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.349297] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.349536] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 682.349678] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.349848] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-529" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.350214] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-1c88f2bc-ffab-4092-b46c-4eec42eab187 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.350563] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-1c88f2bc-ffab-4092-b46c-4eec42eab187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.350816] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-1c88f2bc-ffab-4092-b46c-4eec42eab187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.351179] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-1c88f2bc-ffab-4092-b46c-4eec42eab187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.351278] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c88f2bc-ffab-4092-b46c-4eec42eab187',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.444891] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42ae76b-69ae-499f-b565-4ede857c249b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.445202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.445553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.445822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.446083] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.446688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.446863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.447130] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.447308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.447633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.447702] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42ae76b-69ae-499f-b565-4ede857c249b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.447764] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.447825] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.447981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.450449] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.450449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.450449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.450449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.450449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.450449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.450449] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.558208] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.558208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.558208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.558208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.558208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.558208] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 832015c1-81fd-4bf2-88c3-58e97531a611 is going to be created. [ 682.586013] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.586166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.586250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.588727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.588727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.602698] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 832015c1-81fd-4bf2-88c3-58e97531a611 in Status: UNINITIALIZED for 2s [ 682.854374] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.855377] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.855377] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.855377] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.855524] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.855622] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 1c88f2bc-ffab-4092-b46c-4eec42eab187 not found, creating... [ 682.855945] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.856174] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.856312] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.856628] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.856826] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.857261] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.857461] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.857585] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.857859] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.858040] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.858176] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 1c88f2bc-ffab-4092-b46c-4eec42eab187 is going to be created. [ 682.881329] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.881779] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.881903] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.882156] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.882477] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.882772] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-1c88f2bc-ffab-4092-b46c-4eec42eab187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.952993] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c42ae76b-69ae-499f-b565-4ede857c249b: rpc.has_security_group_logging(os_id): False [ 682.974686] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.974947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.974947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.975146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.975313] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.975899] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.975899] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.975899] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.976180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.976255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.976510] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.976638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.976762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.976868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.976947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.977170] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.977287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.977357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.977801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.977801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.977801] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c42ae76b-69ae-499f-b565-4ede857c249b is going to be updated. [ 683.094957] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.094957] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.094957] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.095306] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.095306] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.146531] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c42ae76b-69ae-499f-b565-4ede857c249b in Status: IN_PROGRESS for 2s [ 683.607424] env[65413]: INFO networking_nsxv3.common.synchronization [req-4f6d0c7a-1fe3-4b30-833b-10db08239305 req-aaa0370a-f774-482a-9542-bac48826cb10 service nova] Enqueued Resource ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 with Priority: HIGHEST for action security_group_rules [ 683.607424] env[65413]: INFO networking_nsxv3.common.synchronization [req-4f6d0c7a-1fe3-4b30-833b-10db08239305 req-aaa0370a-f774-482a-9542-bac48826cb10 service nova] Enqueued Resource ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 with Priority: HIGHEST for action security_group_members [ 683.607424] env[65413]: INFO networking_nsxv3.common.synchronization [req-4f6d0c7a-1fe3-4b30-833b-10db08239305 req-aaa0370a-f774-482a-9542-bac48826cb10 service nova] Enqueued Resource ID: 1c88f2bc-ffab-4092-b46c-4eec42eab187 with Priority: HIGHEST for action port [ 683.607424] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 with Priority: HIGHEST for action security_group_rules [ 683.607424] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 with Priority: HIGHEST for action security_group_members [ 683.607424] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c88f2bc-ffab-4092-b46c-4eec42eab187 with Priority: HIGHEST for action port [ 683.607424] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.608383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.608383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.608745] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.608745] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.610146] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.610286] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.610394] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.610673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.610900] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.611115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.611115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.611264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.611350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.611447] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.616298] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c88f2bc-ffab-4092-b46c-4eec42eab187 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.616482] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c88f2bc-ffab-4092-b46c-4eec42eab187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.616571] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c88f2bc-ffab-4092-b46c-4eec42eab187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.616784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c88f2bc-ffab-4092-b46c-4eec42eab187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.616870] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c88f2bc-ffab-4092-b46c-4eec42eab187',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.115470] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.118878] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.119020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.122670] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c88f2bc-ffab-4092-b46c-4eec42eab187 with status ACTIVE [ 684.122757] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.122899] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.122968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.123490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.123490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.123490] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.123684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.123684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.123820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.123902] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.124133] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.124218] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.124259] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.124949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.124949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.124949] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c88f2bc-ffab-4092-b46c-4eec42eab187 is going to be updated. [ 684.149849] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.150431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.150431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.150431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.150600] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.150649] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c88f2bc-ffab-4092-b46c-4eec42eab187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.500076] env[65413]: INFO networking_nsxv3.common.synchronization [req-ac2d2a89-3a28-43b3-9a1d-72d983c306ca req-bad6795e-836a-44f6-9843-75480247e48d tempest-ServersAdminNegativeTestJSON-1139809485 tempest-ServersAdminNegativeTestJSON-1139809485-project-member] Enqueued Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_members [ 684.500878] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_members [ 684.501097] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5899503-b7f8-4b26-9b77-05fdacbf5c20 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.501225] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.501418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.503073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.503307] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.503779] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.503779] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.503779] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.503779] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.504054] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.615892] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 832015c1-81fd-4bf2-88c3-58e97531a611 in Status: SUCCESS [ 684.616596] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.617142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.617142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.617142] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.617387] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.617387] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.617475] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.617605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.617650] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.617742] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('832015c1-81fd-4bf2-88c3-58e97531a611',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.619428] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.891946] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.892193] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.892282] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.892548] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.892814] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.892960] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.893079] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.893288] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.893427] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.893634] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.893741] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.893856] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.893940] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.894075] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.894160] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.894249] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.915802] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.915966] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 684.916111] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.916280] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.916590] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-26d86b77-d1b9-4bc4-b224-28e8e675b0e9 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.916755] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-26d86b77-d1b9-4bc4-b224-28e8e675b0e9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.916864] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-26d86b77-d1b9-4bc4-b224-28e8e675b0e9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.917223] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-26d86b77-d1b9-4bc4-b224-28e8e675b0e9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.917453] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26d86b77-d1b9-4bc4-b224-28e8e675b0e9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.008481] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.008481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.008481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.008481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.008481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.008481] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.008481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.008481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.008481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.008481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.008481] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 already deleted. [ 685.008481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.123268] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('832015c1-81fd-4bf2-88c3-58e97531a611',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.123268] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.123268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.123268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.123268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.123268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.123268] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 is going to be created. [ 685.149066] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.149164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.149240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.149541] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.149778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.159930] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 in Status: UNINITIALIZED for 2s [ 685.163023] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c42ae76b-69ae-499f-b565-4ede857c249b in Status: SUCCESS [ 685.163281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.423413] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.423413] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.423413] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.423413] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.423413] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.423413] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 26d86b77-d1b9-4bc4-b224-28e8e675b0e9 not found, creating... [ 685.423413] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.423413] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.423413] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.423413] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.423413] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.423832] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.423832] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.423832] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.423832] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.424308] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.424598] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 26d86b77-d1b9-4bc4-b224-28e8e675b0e9 is going to be created. [ 685.449919] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.449919] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.449919] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.449919] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.449919] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.449919] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-26d86b77-d1b9-4bc4-b224-28e8e675b0e9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.628061] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 832015c1-81fd-4bf2-88c3-58e97531a611: rpc.has_security_group_logging(os_id): False [ 685.649617] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.649715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.649773] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.649985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.650085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.650319] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.650446] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.650632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.651568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.651568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.651568] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 832015c1-81fd-4bf2-88c3-58e97531a611 is going to be created. [ 685.720691] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.720886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.720942] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.721185] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.721415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.741797] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 832015c1-81fd-4bf2-88c3-58e97531a611 in Status: IN_PROGRESS for 2s [ 686.263724] env[65413]: INFO networking_nsxv3.common.synchronization [req-ac2d2a89-3a28-43b3-9a1d-72d983c306ca req-ab4f406a-98ab-42ca-990b-737c1448e742 service nova] Enqueued Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_rules [ 686.264076] env[65413]: INFO networking_nsxv3.common.synchronization [req-ac2d2a89-3a28-43b3-9a1d-72d983c306ca req-ab4f406a-98ab-42ca-990b-737c1448e742 service nova] Enqueued Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_members [ 686.264076] env[65413]: INFO networking_nsxv3.common.synchronization [req-ac2d2a89-3a28-43b3-9a1d-72d983c306ca req-ab4f406a-98ab-42ca-990b-737c1448e742 service nova] Enqueued Resource ID: 26d86b77-d1b9-4bc4-b224-28e8e675b0e9 with Priority: HIGHEST for action port [ 686.264574] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_rules [ 686.264703] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_members [ 686.264798] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26d86b77-d1b9-4bc4-b224-28e8e675b0e9 with Priority: HIGHEST for action port [ 686.265289] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5899503-b7f8-4b26-9b77-05fdacbf5c20 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.265488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.268972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.268972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.268972] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.268972] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5899503-b7f8-4b26-9b77-05fdacbf5c20 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.268972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.268972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.268972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.268972] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.268972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.268972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.268972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.268972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.268972] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.269712] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-26d86b77-d1b9-4bc4-b224-28e8e675b0e9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.269956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26d86b77-d1b9-4bc4-b224-28e8e675b0e9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.270064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26d86b77-d1b9-4bc4-b224-28e8e675b0e9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.270260] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26d86b77-d1b9-4bc4-b224-28e8e675b0e9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.270380] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26d86b77-d1b9-4bc4-b224-28e8e675b0e9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.773519] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 26d86b77-d1b9-4bc4-b224-28e8e675b0e9 with status ACTIVE [ 686.773762] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.773915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.773997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.774322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.774721] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.774721] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.774850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.774850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.775051] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.775178] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.775382] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.775446] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.775482] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.775650] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.775727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.775811] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 26d86b77-d1b9-4bc4-b224-28e8e675b0e9 is going to be updated. [ 686.777007] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.778713] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5899503-b7f8-4b26-9b77-05fdacbf5c20 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.778823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.779903] env[65413]: INFO networking_nsxv3.common.synchronization [None req-58358cca-9d13-434b-83f7-7658dbfbc171 tempest-MigrationsAdminTest-1569866777 tempest-MigrationsAdminTest-1569866777-project-member] Enqueued Resource ID: bec35fae-082d-41ed-984f-27169eb7e1bc with Priority: HIGHEST for action security_group_rules [ 686.781828] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec35fae-082d-41ed-984f-27169eb7e1bc with Priority: HIGHEST for action security_group_rules [ 686.782176] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bec35fae-082d-41ed-984f-27169eb7e1bc taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.782298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bec35fae-082d-41ed-984f-27169eb7e1bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.782365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bec35fae-082d-41ed-984f-27169eb7e1bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.782661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bec35fae-082d-41ed-984f-27169eb7e1bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.782745] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bec35fae-082d-41ed-984f-27169eb7e1bc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.820213] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.820213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.820213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.820213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.820507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.820507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26d86b77-d1b9-4bc4-b224-28e8e675b0e9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.930916] env[65413]: INFO networking_nsxv3.common.synchronization [None req-f94d87d8-8fae-4fdc-a609-c5e9cff017a3 tempest-MigrationsAdminTest-1569866777 tempest-MigrationsAdminTest-1569866777-project-member] Enqueued Resource ID: bec35fae-082d-41ed-984f-27169eb7e1bc with Priority: HIGHEST for action security_group_rules [ 686.931454] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bec35fae-082d-41ed-984f-27169eb7e1bc with Priority: HIGHEST for action security_group_rules [ 686.931750] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bec35fae-082d-41ed-984f-27169eb7e1bc taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.936177] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bec35fae-082d-41ed-984f-27169eb7e1bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.170601] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 in Status: SUCCESS [ 687.170601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.170690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.170876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.171084] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.171741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.171741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.171741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.171741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.171741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.171741] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.284624] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.326954] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.327210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.327210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.327537] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.327627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.327725] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bec35fae-082d-41ed-984f-27169eb7e1bc already deleted. [ 687.327809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bec35fae-082d-41ed-984f-27169eb7e1bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.327963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bec35fae-082d-41ed-984f-27169eb7e1bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.328159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bec35fae-082d-41ed-984f-27169eb7e1bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.328242] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bec35fae-082d-41ed-984f-27169eb7e1bc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.674780] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.675200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.675200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.675403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.675642] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.675790] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.675984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.676084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.676196] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.676319] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.676529] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.677875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.677875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.677875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.677875] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.677875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.677875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.677875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.677875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.677875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.678309] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.757905] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 832015c1-81fd-4bf2-88c3-58e97531a611 in Status: SUCCESS [ 687.758159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.788052] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.788419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.788419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.788419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.788664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.788664] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 is going to be created. [ 687.828444] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.828444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.828444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.828753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.828753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.847964] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 in Status: UNINITIALIZED for 2s [ 687.851997] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.851997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.851997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.852519] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.852519] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.852519] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bec35fae-082d-41ed-984f-27169eb7e1bc already deleted. [ 687.852519] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bec35fae-082d-41ed-984f-27169eb7e1bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.183154] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3: rpc.has_security_group_logging(os_id): False [ 688.204522] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.204736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.204736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.204958] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.206763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.206763] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.206763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.206763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.206763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.206763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.206763] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.206763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.206763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.206763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.206763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.206763] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.206763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.206763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.207459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.207459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.207459] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 is going to be created. [ 688.280143] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.280294] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.280417] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.280585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.280757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.292667] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 in Status: IN_PROGRESS for 2s [ 689.701176] env[65413]: INFO networking_nsxv3.common.synchronization [req-961960ab-0c11-4ba5-96e7-505d36590f02 req-a2d2a5cc-5f45-4a86-93ac-389ba155c463 tempest-ServerGroupTestJSON-651024800 tempest-ServerGroupTestJSON-651024800-project-member] Enqueued Resource ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c with Priority: HIGHEST for action security_group_members [ 689.701609] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c with Priority: HIGHEST for action security_group_members [ 689.701885] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.702014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.702090] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.702347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.702744] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.703100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.703100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.703100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.703294] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.703470] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.900497] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 in Status: SUCCESS [ 689.900497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.900497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.900497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.900497] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.900497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.900497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.900497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.900497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.900497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.900497] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.206088] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.206296] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.206381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.206640] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.206769] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.207042] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.207162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.207276] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.207459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.207506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.207621] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c already deleted. [ 690.207711] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.322110] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 in Status: SUCCESS [ 690.322513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.366504] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5899503-b7f8-4b26-9b77-05fdacbf5c20 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.366701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.366778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.366997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.367592] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.367592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.367592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.367592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.367592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.367797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.367823] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5899503-b7f8-4b26-9b77-05fdacbf5c20 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.367920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.367980] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.368163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.368289] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.368384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.368446] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.368583] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.368656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.368734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.368820] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.471630] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-144 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.471823] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-144" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.472017] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-144" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.472316] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-144" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.472588] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.472761] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.472870] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.473101] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.473254] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.473482] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.473565] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 690.473689] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 690.473821] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 690.473903] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 690.474011] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 690.474152] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 690.497064] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 690.497348] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 690.497571] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 690.497875] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-144" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.498331] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-c6ecd9a5-1e82-43c9-8092-48d5a104350c taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.498512] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-c6ecd9a5-1e82-43c9-8092-48d5a104350c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.498625] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-c6ecd9a5-1e82-43c9-8092-48d5a104350c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.499026] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-c6ecd9a5-1e82-43c9-8092-48d5a104350c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.499118] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6ecd9a5-1e82-43c9-8092-48d5a104350c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.875130] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5899503-b7f8-4b26-9b77-05fdacbf5c20: rpc.has_security_group_logging(os_id): False [ 690.905303] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.905511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.905511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.905752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.905860] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.906082] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.906226] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.906252] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.906470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.906584] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.906787] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.906843] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.906938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.911293] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.912167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.912167] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.912167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.912167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.912386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.912476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.912560] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 is going to be created. [ 691.003718] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.003718] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.003718] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.003718] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.003718] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.003937] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port c6ecd9a5-1e82-43c9-8092-48d5a104350c not found, creating... [ 691.004125] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.004770] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.004770] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.004770] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.004872] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.005590] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.006030] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.006030] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.006338] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.006450] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.006664] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: c6ecd9a5-1e82-43c9-8092-48d5a104350c is going to be created. [ 691.009361] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.009596] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.009725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.009972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.010250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.023859] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 in Status: IN_PROGRESS for 2s [ 691.036252] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.036772] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.036772] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.036955] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.037103] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.037338] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-c6ecd9a5-1e82-43c9-8092-48d5a104350c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.772970] env[65413]: INFO networking_nsxv3.common.synchronization [req-961960ab-0c11-4ba5-96e7-505d36590f02 req-8cad5814-825d-46cf-a920-2974da35f1f6 service nova] Enqueued Resource ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c with Priority: HIGHEST for action security_group_rules [ 691.773217] env[65413]: INFO networking_nsxv3.common.synchronization [req-961960ab-0c11-4ba5-96e7-505d36590f02 req-8cad5814-825d-46cf-a920-2974da35f1f6 service nova] Enqueued Resource ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c with Priority: HIGHEST for action security_group_members [ 691.773379] env[65413]: INFO networking_nsxv3.common.synchronization [req-961960ab-0c11-4ba5-96e7-505d36590f02 req-8cad5814-825d-46cf-a920-2974da35f1f6 service nova] Enqueued Resource ID: c6ecd9a5-1e82-43c9-8092-48d5a104350c with Priority: HIGHEST for action port [ 691.773979] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c with Priority: HIGHEST for action security_group_rules [ 691.774154] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c with Priority: HIGHEST for action security_group_members [ 691.774275] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6ecd9a5-1e82-43c9-8092-48d5a104350c with Priority: HIGHEST for action port [ 691.774626] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.776074] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.776074] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.776074] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.776074] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.776594] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.776720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.776803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.780164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.780164] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.780164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.780164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.780164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.780164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.780164] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.780718] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6ecd9a5-1e82-43c9-8092-48d5a104350c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.780718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6ecd9a5-1e82-43c9-8092-48d5a104350c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.780718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6ecd9a5-1e82-43c9-8092-48d5a104350c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.780718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6ecd9a5-1e82-43c9-8092-48d5a104350c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.780858] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6ecd9a5-1e82-43c9-8092-48d5a104350c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.284280] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.284280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.284889] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.287356] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6ecd9a5-1e82-43c9-8092-48d5a104350c with status ACTIVE [ 692.287356] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.287856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.288050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.289235] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.289235] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.289235] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.289235] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.289235] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.289235] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.289235] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.289235] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.289570] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.289570] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.289752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.290323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.290433] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6ecd9a5-1e82-43c9-8092-48d5a104350c is going to be updated. [ 692.338985] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.339211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.339259] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.340647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.340647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.340979] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6ecd9a5-1e82-43c9-8092-48d5a104350c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.349228] env[65413]: INFO networking_nsxv3.common.synchronization [None req-e4a8d67a-d273-4761-a463-c6473514bff6 None None] Enqueued Resource ID: 245975d2-e90d-4b82-ac0a-af2e0e7a07e4 with Priority: HIGHEST for action port [ 692.349228] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 245975d2-e90d-4b82-ac0a-af2e0e7a07e4 with Priority: HIGHEST for action port [ 692.349228] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-245975d2-e90d-4b82-ac0a-af2e0e7a07e4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.350569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-245975d2-e90d-4b82-ac0a-af2e0e7a07e4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.351192] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-245975d2-e90d-4b82-ac0a-af2e0e7a07e4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.351297] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-245975d2-e90d-4b82-ac0a-af2e0e7a07e4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.351451] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('245975d2-e90d-4b82-ac0a-af2e0e7a07e4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.787247] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.855585] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 245975d2-e90d-4b82-ac0a-af2e0e7a07e4 [ 692.856101] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.856762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.856762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.857101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.857178] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.857809] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:245975d2-e90d-4b82-ac0a-af2e0e7a07e4 already deleted. [ 692.857809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-245975d2-e90d-4b82-ac0a-af2e0e7a07e4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.041301] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 in Status: SUCCESS [ 693.041709] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.292601] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.292895] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.292895] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.293061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.293150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.293282] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c is going to be created. [ 693.340129] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.340395] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.340560] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.340810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.341029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.359407] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c in Status: UNINITIALIZED for 2s [ 694.170968] env[65413]: INFO networking_nsxv3.common.synchronization [req-ed101bff-fcd4-4b22-a858-78c6a1002a6f req-47e7df2f-34ce-47e8-968f-52a6853685cc tempest-FloatingIPsAssociationNegativeTestJSON-275466521 tempest-FloatingIPsAssociationNegativeTestJSON-275466521-project-member] Enqueued Resource ID: cd34bb24-11b2-4ccc-9316-b0c847939508 with Priority: HIGHEST for action security_group_members [ 694.173418] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd34bb24-11b2-4ccc-9316-b0c847939508 with Priority: HIGHEST for action security_group_members [ 694.173418] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cd34bb24-11b2-4ccc-9316-b0c847939508 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.173418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.173418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.173418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.173418] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.173418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.173960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.174188] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.174366] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.174536] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cd34bb24-11b2-4ccc-9316-b0c847939508',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.556589] env[65413]: INFO networking_nsxv3.common.synchronization [None req-9a203e94-3173-4d39-94e7-f18274440cef None None] Enqueued Resource ID: 5afb8f81-9035-4b4b-9ed2-285326e4cdfd with Priority: HIGHEST for action port [ 694.556884] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5afb8f81-9035-4b4b-9ed2-285326e4cdfd with Priority: HIGHEST for action port [ 694.557273] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-5afb8f81-9035-4b4b-9ed2-285326e4cdfd taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.557445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5afb8f81-9035-4b4b-9ed2-285326e4cdfd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.557556] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5afb8f81-9035-4b4b-9ed2-285326e4cdfd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.557774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5afb8f81-9035-4b4b-9ed2-285326e4cdfd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.557858] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5afb8f81-9035-4b4b-9ed2-285326e4cdfd',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.678774] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.678774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.678774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.678774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.678774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.678774] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.679246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.679246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.679246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.679246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.679392] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd34bb24-11b2-4ccc-9316-b0c847939508 is going to be updated. [ 694.717819] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.717819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.717819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.717819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.717819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.728171] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd34bb24-11b2-4ccc-9316-b0c847939508 in Status: IN_PROGRESS for 2s [ 695.062193] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5afb8f81-9035-4b4b-9ed2-285326e4cdfd [ 695.062531] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.062638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.062671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.062988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.063162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.063434] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5afb8f81-9035-4b4b-9ed2-285326e4cdfd already deleted. [ 695.063434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5afb8f81-9035-4b4b-9ed2-285326e4cdfd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.371537] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c in Status: SUCCESS [ 695.371758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.372113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.372499] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.372713] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.372853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.372938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.373127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.373284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.373374] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.373445] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.448033] env[65413]: INFO networking_nsxv3.common.synchronization [None req-92faa685-955b-4987-a7c2-80d27ada7079 None None] Enqueued Resource ID: 9243fc44-8bfb-4504-bbd7-02fbf15aac6b with Priority: HIGHEST for action port [ 695.448679] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9243fc44-8bfb-4504-bbd7-02fbf15aac6b with Priority: HIGHEST for action port [ 695.452452] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-9243fc44-8bfb-4504-bbd7-02fbf15aac6b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.452452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9243fc44-8bfb-4504-bbd7-02fbf15aac6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.452452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9243fc44-8bfb-4504-bbd7-02fbf15aac6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.452452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9243fc44-8bfb-4504-bbd7-02fbf15aac6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.452452] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9243fc44-8bfb-4504-bbd7-02fbf15aac6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.876561] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.878091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.879562] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.885073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.885073] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.885073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.885073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.885073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.885073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.885073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.885073] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.885073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.885073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.885073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.885073] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.885073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.885748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.885748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.885748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.885748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.885748] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.958589] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9243fc44-8bfb-4504-bbd7-02fbf15aac6b [ 695.958873] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.959033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.959123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.959369] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.959468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.959901] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9243fc44-8bfb-4504-bbd7-02fbf15aac6b already deleted. [ 695.960349] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9243fc44-8bfb-4504-bbd7-02fbf15aac6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.123753] env[65413]: INFO networking_nsxv3.common.synchronization [req-51f08125-7601-4116-a6d5-073c6c0bdcc4 req-de7a54b2-6eeb-496a-a420-b7394d1c58fc tempest-ImagesOneServerTestJSON-971250030 tempest-ImagesOneServerTestJSON-971250030-project-member] Enqueued Resource ID: 58542666-ecc3-4c4c-bed5-143746872487 with Priority: HIGHEST for action security_group_members [ 696.124412] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58542666-ecc3-4c4c-bed5-143746872487 with Priority: HIGHEST for action security_group_members [ 696.124780] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-58542666-ecc3-4c4c-bed5-143746872487 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.124921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.125033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.125287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.125522] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.126020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.126125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.126322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.126443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.126593] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('58542666-ecc3-4c4c-bed5-143746872487',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.389039] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c: rpc.has_security_group_logging(os_id): False [ 696.409053] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.410152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.410152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.410152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.410289] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.410601] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.410661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.410691] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.411100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.411207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.411479] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.411554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.411652] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.411881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.411985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.416998] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.416998] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.417153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.417230] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.417662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.417662] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c is going to be created. [ 696.491105] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.491105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.491105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.491105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.491105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.501974] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c in Status: IN_PROGRESS for 2s [ 696.631186] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.631186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.631186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.631352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.631466] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.631738] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.631876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.631960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.632390] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.633887] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.633887] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58542666-ecc3-4c4c-bed5-143746872487 is going to be updated. [ 696.677016] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.677016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.677016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.677280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.677484] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.700631] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58542666-ecc3-4c4c-bed5-143746872487 in Status: IN_PROGRESS for 2s [ 696.739314] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cd34bb24-11b2-4ccc-9316-b0c847939508 in Status: SUCCESS [ 696.739314] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cd34bb24-11b2-4ccc-9316-b0c847939508 deletion is rescheduled due to dependency. [ 696.739314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cd34bb24-11b2-4ccc-9316-b0c847939508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.564310] env[65413]: INFO networking_nsxv3.common.synchronization [None req-0c48e36d-6430-4d0a-9169-9385520e65a1 None None] Enqueued Resource ID: e7886b33-582f-496b-868b-a66b2dd8def5 with Priority: HIGHEST for action port [ 697.564759] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7886b33-582f-496b-868b-a66b2dd8def5 with Priority: HIGHEST for action port [ 697.568023] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7886b33-582f-496b-868b-a66b2dd8def5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.568023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7886b33-582f-496b-868b-a66b2dd8def5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.568023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7886b33-582f-496b-868b-a66b2dd8def5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.568023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7886b33-582f-496b-868b-a66b2dd8def5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.568023] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7886b33-582f-496b-868b-a66b2dd8def5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.069527] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7886b33-582f-496b-868b-a66b2dd8def5 [ 698.069832] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.069984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.070084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.070580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.070690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.070803] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7886b33-582f-496b-868b-a66b2dd8def5 already deleted. [ 698.070887] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7886b33-582f-496b-868b-a66b2dd8def5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.267907] env[65413]: INFO networking_nsxv3.common.synchronization [req-7662f3bb-1658-4239-ac70-824234a1c989 req-3b728780-ce85-4dc1-b32a-a26e9601bf45 tempest-MultipleCreateTestJSON-1512040954 tempest-MultipleCreateTestJSON-1512040954-project-member] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 698.269195] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 698.269782] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.271756] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.271834] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.272090] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.272375] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.272553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.272553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.272717] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.272927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.272927] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.275095] env[65413]: INFO networking_nsxv3.common.synchronization [None req-1c2000e9-1ba4-4aab-b616-1fb473f30f62 tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 with Priority: HIGHEST for action security_group_rules [ 698.275638] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 with Priority: HIGHEST for action security_group_rules [ 698.275961] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.276163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.277450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.277450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.277450] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b9c29e6-4adf-4695-9f0a-75daeb6daeb9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.495780] env[65413]: INFO networking_nsxv3.common.synchronization [None req-79dd0005-5a4c-4ac9-9619-c11832da3def tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 with Priority: HIGHEST for action security_group_rules [ 698.496637] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 with Priority: HIGHEST for action security_group_rules [ 698.498102] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.498289] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.517529] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c in Status: SUCCESS [ 698.517529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.710386] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 58542666-ecc3-4c4c-bed5-143746872487 in Status: SUCCESS [ 698.713069] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 58542666-ecc3-4c4c-bed5-143746872487 deletion is rescheduled due to dependency. [ 698.713069] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-58542666-ecc3-4c4c-bed5-143746872487" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.778588] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.778784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.778865] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.779192] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.779304] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.779560] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.779674] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.779751] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.779945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.780024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.780135] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be updated. [ 698.818242] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.818242] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.818242] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.818242] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.818242] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.818242] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 already deleted. [ 698.818242] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.818242] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.818242] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.818242] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b9c29e6-4adf-4695-9f0a-75daeb6daeb9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.824607] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.824607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.824607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.824607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.824607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.841423] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: IN_PROGRESS for 2s [ 698.900147] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.900147] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.900401] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.901333] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.902095] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.902899] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.903313] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.907022] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.907022] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.907022] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.907022] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.907022] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.907022] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.907022] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.907022] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.907022] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.926928] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.926928] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 698.926928] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.926928] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.927435] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-bdc614ae-dd15-43e6-9f89-4414dc52b0fe taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.927908] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-bdc614ae-dd15-43e6-9f89-4414dc52b0fe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.928049] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-bdc614ae-dd15-43e6-9f89-4414dc52b0fe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.928610] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-bdc614ae-dd15-43e6-9f89-4414dc52b0fe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.928757] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdc614ae-dd15-43e6-9f89-4414dc52b0fe',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.346618] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.346801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.346839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.347263] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.347375] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.347424] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 already deleted. [ 699.347535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.431728] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.431996] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.432136] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.432475] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.432626] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.432777] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port bdc614ae-dd15-43e6-9f89-4414dc52b0fe not found, creating... [ 699.433271] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.433271] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.433463] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.433670] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.433841] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.434420] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.434550] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.434647] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.434965] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.435117] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.435275] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: bdc614ae-dd15-43e6-9f89-4414dc52b0fe is going to be created. [ 699.471225] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.472016] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.472016] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.472016] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.472310] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.472671] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-bdc614ae-dd15-43e6-9f89-4414dc52b0fe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.169423] env[65413]: INFO networking_nsxv3.common.synchronization [req-99ae0021-ea3f-47ac-8644-94990960b1fd req-0e8e3c3b-51fe-43ec-97c8-7a3dfc6e312e tempest-ServerRescueTestJSONUnderV235-958519432 tempest-ServerRescueTestJSONUnderV235-958519432-project-member] Enqueued Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_members [ 700.169423] env[65413]: INFO networking_nsxv3.common.synchronization [req-99ae0021-ea3f-47ac-8644-94990960b1fd req-0e8e3c3b-51fe-43ec-97c8-7a3dfc6e312e tempest-ServerRescueTestJSONUnderV235-958519432 tempest-ServerRescueTestJSONUnderV235-958519432-project-member] Enqueued Resource ID: 9b706cb2-32b8-4347-b854-717f6972c2ce with Priority: HIGHEST for action security_group_members [ 700.171189] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_members [ 700.171189] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b706cb2-32b8-4347-b854-717f6972c2ce with Priority: HIGHEST for action security_group_members [ 700.172539] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.172539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.172539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.172539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.172539] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.172539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.172539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.172539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.172539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.172539] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.173368] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b706cb2-32b8-4347-b854-717f6972c2ce taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.173472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.173871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.173871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.173871] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.173983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.175113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.175113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.175113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.175113] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b706cb2-32b8-4347-b854-717f6972c2ce',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.181283] env[65413]: INFO networking_nsxv3.common.synchronization [req-7662f3bb-1658-4239-ac70-824234a1c989 req-0cea0ed1-46a3-4479-8d52-3b095490d0a3 service nova] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_rules [ 700.181745] env[65413]: INFO networking_nsxv3.common.synchronization [req-7662f3bb-1658-4239-ac70-824234a1c989 req-0cea0ed1-46a3-4479-8d52-3b095490d0a3 service nova] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 700.181745] env[65413]: INFO networking_nsxv3.common.synchronization [req-7662f3bb-1658-4239-ac70-824234a1c989 req-0cea0ed1-46a3-4479-8d52-3b095490d0a3 service nova] Enqueued Resource ID: bdc614ae-dd15-43e6-9f89-4414dc52b0fe with Priority: HIGHEST for action port [ 700.182066] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_rules [ 700.182838] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 700.182838] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdc614ae-dd15-43e6-9f89-4414dc52b0fe with Priority: HIGHEST for action port [ 700.182838] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.183283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.183373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.184502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.184502] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.184792] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.184792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.185124] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdc614ae-dd15-43e6-9f89-4414dc52b0fe taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.185124] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdc614ae-dd15-43e6-9f89-4414dc52b0fe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.185124] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdc614ae-dd15-43e6-9f89-4414dc52b0fe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.186840] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdc614ae-dd15-43e6-9f89-4414dc52b0fe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.186922] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdc614ae-dd15-43e6-9f89-4414dc52b0fe',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.228195] env[65413]: INFO networking_nsxv3.common.synchronization [req-99ae0021-ea3f-47ac-8644-94990960b1fd req-0e8e3c3b-51fe-43ec-97c8-7a3dfc6e312e tempest-ServerRescueTestJSONUnderV235-958519432 tempest-ServerRescueTestJSONUnderV235-958519432-project-member] Enqueued Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_rules [ 700.228398] env[65413]: INFO networking_nsxv3.common.synchronization [req-99ae0021-ea3f-47ac-8644-94990960b1fd req-0e8e3c3b-51fe-43ec-97c8-7a3dfc6e312e tempest-ServerRescueTestJSONUnderV235-958519432 tempest-ServerRescueTestJSONUnderV235-958519432-project-member] Enqueued Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_members [ 700.228497] env[65413]: INFO networking_nsxv3.common.synchronization [req-99ae0021-ea3f-47ac-8644-94990960b1fd req-0e8e3c3b-51fe-43ec-97c8-7a3dfc6e312e tempest-ServerRescueTestJSONUnderV235-958519432 tempest-ServerRescueTestJSONUnderV235-958519432-project-member] Enqueued Resource ID: 9b706cb2-32b8-4347-b854-717f6972c2ce with Priority: HIGHEST for action security_group_rules [ 700.228619] env[65413]: INFO networking_nsxv3.common.synchronization [req-99ae0021-ea3f-47ac-8644-94990960b1fd req-0e8e3c3b-51fe-43ec-97c8-7a3dfc6e312e tempest-ServerRescueTestJSONUnderV235-958519432 tempest-ServerRescueTestJSONUnderV235-958519432-project-member] Enqueued Resource ID: 9b706cb2-32b8-4347-b854-717f6972c2ce with Priority: HIGHEST for action security_group_members [ 700.228738] env[65413]: INFO networking_nsxv3.common.synchronization [req-99ae0021-ea3f-47ac-8644-94990960b1fd req-0e8e3c3b-51fe-43ec-97c8-7a3dfc6e312e tempest-ServerRescueTestJSONUnderV235-958519432 tempest-ServerRescueTestJSONUnderV235-958519432-project-member] Enqueued Resource ID: 07516081-95d5-411b-9914-1f658ec348e5 with Priority: HIGHEST for action port [ 700.229595] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_rules [ 700.229765] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b706cb2-32b8-4347-b854-717f6972c2ce with Priority: HIGHEST for action security_group_rules [ 700.229895] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07516081-95d5-411b-9914-1f658ec348e5 with Priority: HIGHEST for action port [ 700.230161] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_members [ 700.230161] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b706cb2-32b8-4347-b854-717f6972c2ce with Priority: HIGHEST for action security_group_members [ 700.230539] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.230679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.230810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.231018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.231141] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.232112] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b706cb2-32b8-4347-b854-717f6972c2ce taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.232260] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.232348] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.232639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.232926] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b706cb2-32b8-4347-b854-717f6972c2ce',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.233583] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-07516081-95d5-411b-9914-1f658ec348e5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.233720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.235569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.235569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.235569] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07516081-95d5-411b-9914-1f658ec348e5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.235569] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.235569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.235916] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b706cb2-32b8-4347-b854-717f6972c2ce taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.235916] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.676453] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.680473] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b706cb2-32b8-4347-b854-717f6972c2ce',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.688814] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bdc614ae-dd15-43e6-9f89-4414dc52b0fe with status ACTIVE [ 700.689231] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.689527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.691033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.691033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.691033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.691033] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.691033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.691033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.691033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.691033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.691033] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.691033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.691033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.691444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.691444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.691444] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bdc614ae-dd15-43e6-9f89-4414dc52b0fe is going to be updated. [ 700.693140] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.693261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.717703] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.719397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.719397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.719397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.719397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.719397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdc614ae-dd15-43e6-9f89-4414dc52b0fe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.737568] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.737916] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.738281] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07516081-95d5-411b-9914-1f658ec348e5 with status ACTIVE [ 700.740698] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.740698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.740698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.740698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.740698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.740698] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.740698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.740698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.740698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.740698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.740698] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.740698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.740698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.740698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.740698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.740698] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07516081-95d5-411b-9914-1f658ec348e5 is going to be updated. [ 700.743060] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b706cb2-32b8-4347-b854-717f6972c2ce taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.743060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.773424] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.773595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.773595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.773595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.774238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.774393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.857661] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: SUCCESS [ 700.857661] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 deletion is rescheduled due to dependency. [ 700.857661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.857661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.857661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.857661] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.857661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.857661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.858650] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.858650] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.858650] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.136411] env[65413]: INFO networking_nsxv3.common.synchronization [req-7662f3bb-1658-4239-ac70-824234a1c989 req-9d8f28cc-7302-4939-a46d-29772fb6892b tempest-MultipleCreateTestJSON-1512040954 tempest-MultipleCreateTestJSON-1512040954-project-member] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 701.137053] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 701.137458] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.137588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.179707] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.185223] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b706cb2-32b8-4347-b854-717f6972c2ce',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.361422] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.527446] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.527769] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.527887] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.530131] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.530348] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.530627] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.530747] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.531114] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.531114] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.531319] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.531424] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 701.531522] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 701.531672] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 701.531716] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 701.531816] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 701.531940] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 701.553934] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 701.554112] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 701.554249] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 701.554412] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-94" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.554722] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-f88d5e82-8dd4-47bd-8337-28cce6809a6f taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.554893] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-f88d5e82-8dd4-47bd-8337-28cce6809a6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.555013] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-f88d5e82-8dd4-47bd-8337-28cce6809a6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.555376] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-f88d5e82-8dd4-47bd-8337-28cce6809a6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.555508] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f88d5e82-8dd4-47bd-8337-28cce6809a6f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.685951] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.686093] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.687844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.687844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.687844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.687844] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 is going to be updated. [ 701.688087] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.689022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.689022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.689022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.689022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.689022] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b706cb2-32b8-4347-b854-717f6972c2ce is going to be created. [ 701.728014] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.729186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.729186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.732133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.732133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.732205] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.732300] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.732365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.732567] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.732698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.744513] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: IN_PROGRESS for 2s [ 701.747158] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b706cb2-32b8-4347-b854-717f6972c2ce in Status: UNINITIALIZED for 2s [ 701.863887] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.057625] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.057880] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.058025] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.058340] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.058515] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.058648] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port f88d5e82-8dd4-47bd-8337-28cce6809a6f not found, creating... [ 702.058874] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.059044] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.059159] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.059375] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.059560] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.059845] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.059993] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.060123] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.060326] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.060449] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.060676] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: f88d5e82-8dd4-47bd-8337-28cce6809a6f is going to be created. [ 702.082187] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.082400] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.082511] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.082788] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.083015] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.083460] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-f88d5e82-8dd4-47bd-8337-28cce6809a6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.277081] env[65413]: INFO networking_nsxv3.common.synchronization [req-6a1cd94c-251a-4cca-8341-367cd3ac93eb req-abcc9aaf-768a-410c-ac28-b9f2ab660fd6 tempest-ImagesOneServerNegativeTestJSON-1663656844 tempest-ImagesOneServerNegativeTestJSON-1663656844-project-member] Enqueued Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 702.277753] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 702.278113] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.278244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.278312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.278523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.278746] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.278853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.278915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.279101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.279203] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.279326] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.367112] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.367370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.367926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.367926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.367926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.368105] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be updated. [ 702.417314] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.417314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.417314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.417664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.417664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.428370] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: IN_PROGRESS for 2s [ 702.782047] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.782248] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.782311] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.782581] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.782694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.782935] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.783053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.783148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.783287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.783359] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.783443] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 is going to be updated. [ 702.827367] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.827910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.827910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.827910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.828780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.839015] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: IN_PROGRESS for 2s [ 702.918707] env[65413]: INFO networking_nsxv3.common.synchronization [req-7662f3bb-1658-4239-ac70-824234a1c989 req-d62589df-2b85-452d-bdde-9b07e7b69a91 service nova] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_rules [ 702.919766] env[65413]: INFO networking_nsxv3.common.synchronization [req-7662f3bb-1658-4239-ac70-824234a1c989 req-d62589df-2b85-452d-bdde-9b07e7b69a91 service nova] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 702.920148] env[65413]: INFO networking_nsxv3.common.synchronization [req-7662f3bb-1658-4239-ac70-824234a1c989 req-d62589df-2b85-452d-bdde-9b07e7b69a91 service nova] Enqueued Resource ID: f88d5e82-8dd4-47bd-8337-28cce6809a6f with Priority: HIGHEST for action port [ 702.920660] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_rules [ 702.920818] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 702.920918] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f88d5e82-8dd4-47bd-8337-28cce6809a6f with Priority: HIGHEST for action port [ 702.921467] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.921467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.921602] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.921641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.921816] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-f88d5e82-8dd4-47bd-8337-28cce6809a6f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.921959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f88d5e82-8dd4-47bd-8337-28cce6809a6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.921994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f88d5e82-8dd4-47bd-8337-28cce6809a6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.922219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f88d5e82-8dd4-47bd-8337-28cce6809a6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.922312] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f88d5e82-8dd4-47bd-8337-28cce6809a6f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.042239] env[65413]: INFO networking_nsxv3.common.synchronization [req-5c9c0eac-5403-4d66-b492-f0944f036997 req-c7b2b80b-a943-4d10-a7ca-d11e37ba7129 tempest-ServerRescueTestJSONUnderV235-958519432 tempest-ServerRescueTestJSONUnderV235-958519432-project-member] Enqueued Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_members [ 703.042367] env[65413]: INFO networking_nsxv3.common.synchronization [req-5c9c0eac-5403-4d66-b492-f0944f036997 req-c7b2b80b-a943-4d10-a7ca-d11e37ba7129 tempest-ServerRescueTestJSONUnderV235-958519432 tempest-ServerRescueTestJSONUnderV235-958519432-project-member] Enqueued Resource ID: 9b706cb2-32b8-4347-b854-717f6972c2ce with Priority: HIGHEST for action security_group_members [ 703.043309] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_members [ 703.043458] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b706cb2-32b8-4347-b854-717f6972c2ce with Priority: HIGHEST for action security_group_members [ 703.043779] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.043883] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.044085] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b706cb2-32b8-4347-b854-717f6972c2ce taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.044168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.092204] env[65413]: INFO networking_nsxv3.common.synchronization [req-5c9c0eac-5403-4d66-b492-f0944f036997 req-c7b2b80b-a943-4d10-a7ca-d11e37ba7129 tempest-ServerRescueTestJSONUnderV235-958519432 tempest-ServerRescueTestJSONUnderV235-958519432-project-member] Enqueued Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_rules [ 703.092204] env[65413]: INFO networking_nsxv3.common.synchronization [req-5c9c0eac-5403-4d66-b492-f0944f036997 req-c7b2b80b-a943-4d10-a7ca-d11e37ba7129 tempest-ServerRescueTestJSONUnderV235-958519432 tempest-ServerRescueTestJSONUnderV235-958519432-project-member] Enqueued Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_members [ 703.092204] env[65413]: INFO networking_nsxv3.common.synchronization [req-5c9c0eac-5403-4d66-b492-f0944f036997 req-c7b2b80b-a943-4d10-a7ca-d11e37ba7129 tempest-ServerRescueTestJSONUnderV235-958519432 tempest-ServerRescueTestJSONUnderV235-958519432-project-member] Enqueued Resource ID: 07516081-95d5-411b-9914-1f658ec348e5 with Priority: HIGHEST for action port [ 703.092204] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_rules [ 703.092462] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_members [ 703.092462] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07516081-95d5-411b-9914-1f658ec348e5 with Priority: HIGHEST for action port [ 703.092813] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.092918] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.093131] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.093211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.093382] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-07516081-95d5-411b-9914-1f658ec348e5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.094167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.094167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.094167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.094167] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07516081-95d5-411b-9914-1f658ec348e5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.379774] env[65413]: INFO networking_nsxv3.common.synchronization [req-4099473f-ee96-4b49-a4db-ab9f84c19493 req-6b5b1030-58e5-4fa0-85c5-507be693c2f2 tempest-VolumesAdminNegativeTest-976716430 tempest-VolumesAdminNegativeTest-976716430-project-member] Enqueued Resource ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 with Priority: HIGHEST for action security_group_members [ 703.383908] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 with Priority: HIGHEST for action security_group_members [ 703.383908] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.383908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.383908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.383908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.383908] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.383908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.383908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.383908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.383908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.383908] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.428440] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f88d5e82-8dd4-47bd-8337-28cce6809a6f with status ACTIVE [ 703.428440] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.428440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.428440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.428440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.428440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.428440] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.428440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.428440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.428440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.428440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.428440] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.428440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.428440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.428440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.428440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.428440] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f88d5e82-8dd4-47bd-8337-28cce6809a6f is going to be updated. [ 703.454545] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.454901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.455787] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.456305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.456554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.456797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f88d5e82-8dd4-47bd-8337-28cce6809a6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.598875] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07516081-95d5-411b-9914-1f658ec348e5 with status ACTIVE [ 703.599174] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.599514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.599514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.599666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.599666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.599871] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.599975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.600057] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.600193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.600271] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.600453] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.600568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.600636] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.600801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.600876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.600955] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07516081-95d5-411b-9914-1f658ec348e5 is going to be updated. [ 703.633815] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.633975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.633975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.634292] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.634431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.634626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07516081-95d5-411b-9914-1f658ec348e5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.763281] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b706cb2-32b8-4347-b854-717f6972c2ce in Status: SUCCESS [ 703.763407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.764054] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: SUCCESS [ 703.764222] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.764430] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.764580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.764792] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.764920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.765018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.765160] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.765239] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.765332] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b706cb2-32b8-4347-b854-717f6972c2ce',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.769704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.769704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.769704] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.769704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.769704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.769704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.769704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.769704] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.772610] env[65413]: INFO networking_nsxv3.common.synchronization [req-b7f4308c-1b11-4acb-bb32-7ad33527186a req-53af33b4-b4fe-4ce3-b59e-707db24fc202 tempest-DeleteServersTestJSON-2008533967 tempest-DeleteServersTestJSON-2008533967-project-member] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 703.775986] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 703.776459] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.776596] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.776664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.776873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.777042] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.777162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.777212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.777349] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.777445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.777550] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.888822] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.889029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.889144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.889325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.890249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.890491] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.890633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.890726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.890934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.890990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.891092] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 is going to be updated. [ 703.922946] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.924117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.924117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.924117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.924117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.935877] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 in Status: IN_PROGRESS for 2s [ 704.183641] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-586 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.183839] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.183954] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.184241] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.184498] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.184651] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.184762] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.184996] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.185211] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.185433] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.185532] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.185636] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.185737] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.185837] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.185935] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.186073] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.205982] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.206206] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 704.206350] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.206570] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.206889] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-925bb535-f45c-443e-a12e-475cea0eb3f0 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.207118] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-925bb535-f45c-443e-a12e-475cea0eb3f0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.207271] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-925bb535-f45c-443e-a12e-475cea0eb3f0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.207736] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-925bb535-f45c-443e-a12e-475cea0eb3f0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.207924] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('925bb535-f45c-443e-a12e-475cea0eb3f0',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.269651] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.269888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.269955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.270189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.270279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.270525] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.270687] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.270759] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.270974] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.271071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.271109] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b706cb2-32b8-4347-b854-717f6972c2ce is going to be deleted. [ 704.274237] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.282769] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.283171] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.284019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.284268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.284370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.284575] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.284678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.284779] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.284923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.284992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.285091] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 704.335354] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.335540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.335896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.336552] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.336552] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.346310] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.346486] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.346534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.346767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.346843] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.347000] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.347124] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.347280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.347445] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.347548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.347639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.347972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.347972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.348126] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b706cb2-32b8-4347-b854-717f6972c2ce',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.351254] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 704.439897] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: SUCCESS [ 704.440308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.440308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.442030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.442030] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.442030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.442030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.442030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.442030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.442030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.442030] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.442340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.442411] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.442592] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.442684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.442744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.442910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.443031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.443125] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.711090] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.711310] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.711430] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.711729] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.711898] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.712068] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 925bb535-f45c-443e-a12e-475cea0eb3f0 not found, creating... [ 704.712326] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.712478] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.712587] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.712800] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.712925] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.713209] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.713360] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.713471] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.713665] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.713791] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.713919] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 925bb535-f45c-443e-a12e-475cea0eb3f0 is going to be created. [ 704.733934] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.734192] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.734311] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.734574] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.734805] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.735023] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-925bb535-f45c-443e-a12e-475cea0eb3f0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.776774] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.850874] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: SUCCESS [ 704.851345] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 deletion is rescheduled due to dependency. [ 704.851583] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.854154] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.854436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.854609] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.854977] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.855142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.855485] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.855711] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.855866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.856224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.856646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.856646] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b706cb2-32b8-4347-b854-717f6972c2ce already deleted. [ 704.856761] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.856902] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b706cb2-32b8-4347-b854-717f6972c2ce',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.858515] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.858842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.859130] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.859646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.859646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.859646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.859795] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.859851] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b706cb2-32b8-4347-b854-717f6972c2ce',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.945110] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.945282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.945470] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.279418] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.279622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.279695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.279903] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.280019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.280122] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 is going to be updated. [ 705.343809] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.344039] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.344135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.344391] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.344547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.365025] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b706cb2-32b8-4347-b854-717f6972c2ce',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.365025] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.365025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.365025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.365025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.365025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.365025] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.365025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.365025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.367300] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.367719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.368019] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b706cb2-32b8-4347-b854-717f6972c2ce already deleted. [ 705.368217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.370385] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: IN_PROGRESS for 2s [ 705.448871] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.540090] env[65413]: INFO networking_nsxv3.common.synchronization [req-b7f4308c-1b11-4acb-bb32-7ad33527186a req-9d80b7ab-6fef-47a7-a198-cec71a0117cf service nova] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_rules [ 705.540090] env[65413]: INFO networking_nsxv3.common.synchronization [req-b7f4308c-1b11-4acb-bb32-7ad33527186a req-9d80b7ab-6fef-47a7-a198-cec71a0117cf service nova] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 705.540090] env[65413]: INFO networking_nsxv3.common.synchronization [req-b7f4308c-1b11-4acb-bb32-7ad33527186a req-9d80b7ab-6fef-47a7-a198-cec71a0117cf service nova] Enqueued Resource ID: 925bb535-f45c-443e-a12e-475cea0eb3f0 with Priority: HIGHEST for action port [ 705.544053] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_rules [ 705.544053] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 705.544053] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 925bb535-f45c-443e-a12e-475cea0eb3f0 with Priority: HIGHEST for action port [ 705.544053] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.544053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.544053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.544053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.544053] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.544053] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.544053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.544053] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-925bb535-f45c-443e-a12e-475cea0eb3f0 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.544053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-925bb535-f45c-443e-a12e-475cea0eb3f0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.544053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-925bb535-f45c-443e-a12e-475cea0eb3f0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.550158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-925bb535-f45c-443e-a12e-475cea0eb3f0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.550334] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('925bb535-f45c-443e-a12e-475cea0eb3f0',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.869772] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b706cb2-32b8-4347-b854-717f6972c2ce: rpc.has_security_group_logging(os_id): False [ 705.893689] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.893886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.893986] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.894250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.894373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.894809] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.894809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.894953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.895178] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.895309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.895445] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b706cb2-32b8-4347-b854-717f6972c2ce is going to be created. [ 705.949511] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9b706cb2-32b8-4347-b854-717f6972c2ce], does not exist path=[/infra/domains/default/groups/9b706cb2-32b8-4347-b854-717f6972c2ce]."\n}' [ 705.949810] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b706cb2-32b8-4347-b854-717f6972c2ce failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9b706cb2-32b8-4347-b854-717f6972c2ce [ 705.950095] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 705.951232] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.951373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.951506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.952067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.952067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.952067] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be updated. [ 705.957242] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 in Status: SUCCESS [ 705.957406] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 deletion is rescheduled due to dependency. [ 705.957544] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.997988] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.998160] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.998233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.998487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.999431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.999784] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.999909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.000482] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.000735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.000827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.001054] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.001158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.001219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.001370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.001444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.001529] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b706cb2-32b8-4347-b854-717f6972c2ce is going to be created. [ 706.003533] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.003657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.003828] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.003878] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.004015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.017481] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: IN_PROGRESS for 2s [ 706.029504] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/9b706cb2-32b8-4347-b854-717f6972c2ce], does not exist path=[/infra/domains/default/groups/9b706cb2-32b8-4347-b854-717f6972c2ce]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9b706cb2-32b8-4347-b854-717f6972c2ce [ 706.029679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b706cb2-32b8-4347-b854-717f6972c2ce" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.030469] env[65413]: Traceback (most recent call last): [ 706.030469] env[65413]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 706.030469] env[65413]: return func(*args, **kwargs) [ 706.030469] env[65413]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 706.030469] env[65413]: res.raise_for_status() [ 706.030469] env[65413]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 706.030469] env[65413]: raise HTTPError(http_error_msg, response=self) [ 706.030469] env[65413]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9b706cb2-32b8-4347-b854-717f6972c2ce [ 706.030469] env[65413]: During handling of the above exception, another exception occurred: [ 706.030469] env[65413]: Traceback (most recent call last): [ 706.030469] env[65413]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 706.030469] env[65413]: listener.cb(fileno) [ 706.030469] env[65413]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 706.030469] env[65413]: result = function(*args, **kwargs) [ 706.030469] env[65413]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 706.030469] env[65413]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 706.030469] env[65413]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 706.030469] env[65413]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 706.030469] env[65413]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 706.030469] env[65413]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 706.030469] env[65413]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 706.030469] env[65413]: res.raise_for_status() [ 706.030469] env[65413]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 706.030469] env[65413]: raise HTTPError(http_error_msg, response=self) [ 706.030469] env[65413]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/9b706cb2-32b8-4347-b854-717f6972c2ce [ 706.030469] env[65413]: Removing descriptor: 15 [ 706.053079] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 925bb535-f45c-443e-a12e-475cea0eb3f0 with status ACTIVE [ 706.053727] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.054118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.054304] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.054570] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.054716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.054966] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.055119] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.055196] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.055374] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.055455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.055649] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.055749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.055802] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.055941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.056056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.060022] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 925bb535-f45c-443e-a12e-475cea0eb3f0 is going to be updated. [ 706.060022] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.060022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.089916] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.090248] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.090326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.090569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.091134] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.091338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-925bb535-f45c-443e-a12e-475cea0eb3f0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.367033] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 706.367033] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 deletion is rescheduled due to dependency. [ 706.367033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.367033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.367033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.367033] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.367033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.367033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.367033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.367033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.367033] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.446182] env[65413]: INFO networking_nsxv3.common.synchronization [req-c649b3fb-41e8-4cfd-81eb-0774c5b0b97f req-20cd1b30-428f-4944-8ae0-07dac5cc1f40 tempest-FloatingIPsAssociationTestJSON-939090825 tempest-FloatingIPsAssociationTestJSON-939090825-project-member] Enqueued Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_members [ 706.448074] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_members [ 706.448412] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-185b0179-79b1-4f7f-a796-e81c3eb7726c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.448604] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.448657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.448927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.449253] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.449253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.449253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.449489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.449678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.449816] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.870879] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.952124] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-60 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.952327] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.952554] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.952928] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.953184] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.953363] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.953496] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.953760] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.953919] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.954195] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.955031] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 706.955031] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 706.955031] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 706.955031] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 706.955031] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 706.955031] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 706.956746] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.956746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.956746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.956950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.956979] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.957654] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.957654] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.957654] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.957654] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.957654] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.958033] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c already deleted. [ 706.958033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.978241] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 706.978241] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 706.978441] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 706.978441] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.978768] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.979017] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.979149] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.979467] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.979652] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.372952] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.400221] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: SUCCESS [ 707.400469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.400645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.400924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.401096] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.401213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.401277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.401436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.401559] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.401697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.401806] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.403110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.403110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.403110] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.403110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.403268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.403308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.403360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.403485] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.483036] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.483487] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.483487] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.483642] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.483785] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.483933] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350 not found, creating... [ 707.484211] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.484366] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.484474] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.484718] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.484826] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.485102] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.485248] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.485355] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.485553] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.485676] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.485801] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350 is going to be created. [ 707.508609] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.508961] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.509162] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.509465] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.509777] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.510048] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.876510] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.876510] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.876510] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.876510] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.876510] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.876510] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 707.905613] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.905756] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.905969] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.920183] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.920336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.920388] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.920630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.920786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.930227] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 708.030762] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: SUCCESS [ 708.031052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.031246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.031499] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.031804] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.033088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.033307] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.033540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.033641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.033764] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.221931] env[65413]: INFO networking_nsxv3.common.synchronization [None req-9e0e6181-bf31-4cae-b6fc-1f26975f52a0 None None] Enqueued Resource ID: dfb7e00b-dfe3-40b8-be30-9a93152f387d with Priority: HIGHEST for action port [ 708.223326] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dfb7e00b-dfe3-40b8-be30-9a93152f387d with Priority: HIGHEST for action port [ 708.223326] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-dfb7e00b-dfe3-40b8-be30-9a93152f387d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.223664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dfb7e00b-dfe3-40b8-be30-9a93152f387d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.223740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dfb7e00b-dfe3-40b8-be30-9a93152f387d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.224169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dfb7e00b-dfe3-40b8-be30-9a93152f387d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.224257] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dfb7e00b-dfe3-40b8-be30-9a93152f387d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.254442] env[65413]: INFO networking_nsxv3.common.synchronization [req-c649b3fb-41e8-4cfd-81eb-0774c5b0b97f req-4bece18d-8d72-4f1a-a168-cb9a257de845 service nova] Enqueued Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_rules [ 708.254442] env[65413]: INFO networking_nsxv3.common.synchronization [req-c649b3fb-41e8-4cfd-81eb-0774c5b0b97f req-4bece18d-8d72-4f1a-a168-cb9a257de845 service nova] Enqueued Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_members [ 708.254560] env[65413]: INFO networking_nsxv3.common.synchronization [req-c649b3fb-41e8-4cfd-81eb-0774c5b0b97f req-4bece18d-8d72-4f1a-a168-cb9a257de845 service nova] Enqueued Resource ID: b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350 with Priority: HIGHEST for action port [ 708.254774] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_rules [ 708.254897] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_members [ 708.255015] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350 with Priority: HIGHEST for action port [ 708.255725] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-185b0179-79b1-4f7f-a796-e81c3eb7726c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.255903] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.255950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.256563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.256654] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.258802] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-185b0179-79b1-4f7f-a796-e81c3eb7726c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.259032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.259123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.259485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.261701] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.261882] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.261953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.262166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.262263] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.262363] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.263300] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.263415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.263480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.263643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.263722] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.411106] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.540924] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.726473] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dfb7e00b-dfe3-40b8-be30-9a93152f387d [ 708.726838] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.726959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.727034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.727227] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.727720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.727868] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dfb7e00b-dfe3-40b8-be30-9a93152f387d already deleted. [ 708.727964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dfb7e00b-dfe3-40b8-be30-9a93152f387d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.766180] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-185b0179-79b1-4f7f-a796-e81c3eb7726c taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.766180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.766419] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.767400] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350 with status ACTIVE [ 708.768511] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.768653] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.769258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.769531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.769676] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.769887] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.770224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.770224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.770304] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.770732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.771506] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.773063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.773063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.773063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.773063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.773063] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350 is going to be updated. [ 708.797558] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.797558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.797558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.797820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.797820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.799899] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6abb127-3b8b-4e1f-bf9e-cbc8cd5f0350" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.912840] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.913107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.913235] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.913949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.913949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.913949] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 is going to be updated. [ 708.954017] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.954424] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.954489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.954720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.954856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.968593] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: IN_PROGRESS for 2s [ 709.043580] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.084507] env[65413]: INFO networking_nsxv3.common.synchronization [req-cbe00842-cc8c-4af1-b2d7-1ed7cd14555f req-6e98ca0a-050c-497a-95f6-cc90fac9fae0 tempest-InstanceActionsV221TestJSON-1964290210 tempest-InstanceActionsV221TestJSON-1964290210-project-member] Enqueued Resource ID: bbe38081-099a-4476-a2e0-88f6c84557ca with Priority: HIGHEST for action security_group_members [ 709.086165] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbe38081-099a-4476-a2e0-88f6c84557ca with Priority: HIGHEST for action security_group_members [ 709.086589] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbe38081-099a-4476-a2e0-88f6c84557ca taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.086808] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.086923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.087251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.087973] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.088472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.088591] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.088823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.088960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.089107] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbe38081-099a-4476-a2e0-88f6c84557ca',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.275793] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.547610] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.547960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.547960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.548115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.548206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.548284] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be updated. [ 709.566438] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-40 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.566438] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-40" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.566438] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-40" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.568386] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-40" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.568386] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.568386] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.568386] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.568386] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.568386] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.568386] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.568386] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.568386] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.568767] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.568767] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.568767] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.568935] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.588981] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.589155] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.589212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.589419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.589578] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.593897] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.594309] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 709.594309] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.594309] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-40" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.594569] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-ef4ca923-c07d-4e47-a711-034c9cb8f828 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.594739] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-ef4ca923-c07d-4e47-a711-034c9cb8f828" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.594848] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-ef4ca923-c07d-4e47-a711-034c9cb8f828" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.595207] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-ef4ca923-c07d-4e47-a711-034c9cb8f828" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.595340] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef4ca923-c07d-4e47-a711-034c9cb8f828',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.600535] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.600535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.600535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.600535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.600535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.600535] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.600535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.600535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.601558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.601558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.601558] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbe38081-099a-4476-a2e0-88f6c84557ca already deleted. [ 709.601558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.612636] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: IN_PROGRESS for 2s [ 709.778430] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.781603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.781603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.781603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.781603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.781603] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c is going to be created. [ 709.809278] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.809439] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.809494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.809875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.810014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.829209] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c in Status: UNINITIALIZED for 2s [ 709.943143] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 709.943442] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.943614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.944826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.944826] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.945090] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.945218] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.945381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.945460] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.946934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.946934] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.101241] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.101241] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.101241] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.101589] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.101589] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.101780] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port ef4ca923-c07d-4e47-a711-034c9cb8f828 not found, creating... [ 710.102354] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.102526] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.102648] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.102870] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.103014] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.103295] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.103607] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.103607] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.103753] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.103879] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.104022] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: ef4ca923-c07d-4e47-a711-034c9cb8f828 is going to be created. [ 710.142160] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.142394] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.142509] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.142865] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.143175] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.143486] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-ef4ca923-c07d-4e47-a711-034c9cb8f828" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.449339] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.449839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.449951] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.450464] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.450579] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.450747] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.450830] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.451100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.451234] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.451393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.451783] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.451783] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.451894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.452085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.452293] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.452427] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.452518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.452751] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.452866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.452984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.453123] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.871474] env[65413]: INFO networking_nsxv3.common.synchronization [req-cbe00842-cc8c-4af1-b2d7-1ed7cd14555f req-61fdce98-9e00-49b2-9117-c3fdd27cae7d service nova] Enqueued Resource ID: bbe38081-099a-4476-a2e0-88f6c84557ca with Priority: HIGHEST for action security_group_rules [ 710.871474] env[65413]: INFO networking_nsxv3.common.synchronization [req-cbe00842-cc8c-4af1-b2d7-1ed7cd14555f req-61fdce98-9e00-49b2-9117-c3fdd27cae7d service nova] Enqueued Resource ID: bbe38081-099a-4476-a2e0-88f6c84557ca with Priority: HIGHEST for action security_group_members [ 710.871852] env[65413]: INFO networking_nsxv3.common.synchronization [req-cbe00842-cc8c-4af1-b2d7-1ed7cd14555f req-61fdce98-9e00-49b2-9117-c3fdd27cae7d service nova] Enqueued Resource ID: ef4ca923-c07d-4e47-a711-034c9cb8f828 with Priority: HIGHEST for action port [ 710.872410] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbe38081-099a-4476-a2e0-88f6c84557ca with Priority: HIGHEST for action security_group_rules [ 710.872410] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbe38081-099a-4476-a2e0-88f6c84557ca with Priority: HIGHEST for action security_group_members [ 710.872925] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef4ca923-c07d-4e47-a711-034c9cb8f828 with Priority: HIGHEST for action port [ 710.874426] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbe38081-099a-4476-a2e0-88f6c84557ca taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.874426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.874426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.874426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.874426] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbe38081-099a-4476-a2e0-88f6c84557ca',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.875867] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbe38081-099a-4476-a2e0-88f6c84557ca taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.875867] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.875867] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.877409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.877409] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.877409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.877409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.877409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.877409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.877409] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbe38081-099a-4476-a2e0-88f6c84557ca',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.884590] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef4ca923-c07d-4e47-a711-034c9cb8f828 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.884590] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef4ca923-c07d-4e47-a711-034c9cb8f828" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.884590] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef4ca923-c07d-4e47-a711-034c9cb8f828" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.884590] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef4ca923-c07d-4e47-a711-034c9cb8f828" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.884590] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef4ca923-c07d-4e47-a711-034c9cb8f828',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.957810] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d96dd8be-7e0f-4527-b6b4-1fd21b89c256: rpc.has_security_group_logging(os_id): False [ 710.982890] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: SUCCESS [ 710.982890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.985378] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.985630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.985830] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.986461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.986461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.986461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.986461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.991415] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.992374] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.992374] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.992574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.993012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.021662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.022161] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.023818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.023818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.023818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.023818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.023818] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.023818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.023818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.024188] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.024188] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.024325] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.024461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.024600] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.024786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.024973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.025071] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 711.130530] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.130530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.130530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.130809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.131352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.148395] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 711.386081] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bbe38081-099a-4476-a2e0-88f6c84557ca',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.386358] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbe38081-099a-4476-a2e0-88f6c84557ca taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.386459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.386626] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef4ca923-c07d-4e47-a711-034c9cb8f828 with status ACTIVE [ 711.386784] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.386889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.386954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.387293] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.387293] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.387430] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.387545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.387630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.387758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.387827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.388010] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.388108] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.388166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.388339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.388390] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.388444] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef4ca923-c07d-4e47-a711-034c9cb8f828 is going to be updated. [ 711.418203] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.418203] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.418203] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.418425] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.418425] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.418607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef4ca923-c07d-4e47-a711-034c9cb8f828" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.497360] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.628326] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: SUCCESS [ 711.628326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.628326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.628326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.628326] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.628326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.628326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.628326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.628326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.628326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.628785] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.628903] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.628964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.629561] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.629771] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.629909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.629945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.630101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.630190] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.630269] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.630359] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.858998] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c in Status: SUCCESS [ 711.860337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.863022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.863022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.863022] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.863022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.863550] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.864535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.865087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.867542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.867542] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.888990] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bbe38081-099a-4476-a2e0-88f6c84557ca',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.973591] env[65413]: INFO networking_nsxv3.common.synchronization [req-ba0b3c68-cc70-4336-8a83-ee703227bd56 req-8a4daa5d-b078-4dfb-bbf8-ca2cc581f29a tempest-ServersAdminTestJSON-1071948959 tempest-ServersAdminTestJSON-1071948959-project-member] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 711.974899] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 711.975433] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.975594] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.975737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.975901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.976087] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.976423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.976423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.976423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.976726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.976726] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.999386] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.134561] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa7226ef-74d4-482f-ac1d-bbefed534583: rpc.has_security_group_logging(os_id): False [ 712.155556] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.155771] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.155822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.156041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.184393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.184393] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.184393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.184393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.184393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.185019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.188265] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.188265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.188265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.188265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.188265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.188265] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.188265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.188265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.188265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.188265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.188265] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be updated. [ 712.281761] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.281920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.281992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.282228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.282384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.305946] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: IN_PROGRESS for 2s [ 712.330658] env[65413]: INFO networking_nsxv3.common.synchronization [None req-c50a01b5-d520-4e1e-95f9-4b09f135f5fe None None] Enqueued Resource ID: 5d25409f-54ba-4e0d-aa18-9ec9ec792d95 with Priority: HIGHEST for action port [ 712.332017] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d25409f-54ba-4e0d-aa18-9ec9ec792d95 with Priority: HIGHEST for action port [ 712.334860] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d25409f-54ba-4e0d-aa18-9ec9ec792d95 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.335039] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d25409f-54ba-4e0d-aa18-9ec9ec792d95" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.335211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d25409f-54ba-4e0d-aa18-9ec9ec792d95" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.335411] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d25409f-54ba-4e0d-aa18-9ec9ec792d95" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.335500] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d25409f-54ba-4e0d-aa18-9ec9ec792d95',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.371353] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-185b0179-79b1-4f7f-a796-e81c3eb7726c taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.371353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.371353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.371630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.371728] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.371857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.371893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.372059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.372149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.372272] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.372458] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-185b0179-79b1-4f7f-a796-e81c3eb7726c taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.372458] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.372579] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.372856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.372856] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.373028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.373103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.373496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.373496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.373496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.373496] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.391074] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.391257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.391376] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.391541] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.391637] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.391738] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbe38081-099a-4476-a2e0-88f6c84557ca is going to be created. [ 712.443589] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.443589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.443589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.443589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.443589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.466904] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbe38081-099a-4476-a2e0-88f6c84557ca in Status: UNINITIALIZED for 2s [ 712.483633] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.507044] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.507044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.507261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.508700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.508700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.508700] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 is going to be updated. [ 712.545642] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-743 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.546067] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.546148] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.546488] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.546692] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.546859] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.546968] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.547211] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.547364] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.547723] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.547838] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 712.547941] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 712.548058] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 712.548170] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 712.548269] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 712.548398] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 712.580988] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 712.581286] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 712.581465] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 712.581666] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-743" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.582132] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-d7166668-f516-4cce-9116-aaf6b041b040 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.582307] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-d7166668-f516-4cce-9116-aaf6b041b040" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.582396] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-d7166668-f516-4cce-9116-aaf6b041b040" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.582762] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-d7166668-f516-4cce-9116-aaf6b041b040" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.582888] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7166668-f516-4cce-9116-aaf6b041b040',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.596293] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.596545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.596545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.596667] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.596785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.608666] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: IN_PROGRESS for 2s [ 712.840426] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d25409f-54ba-4e0d-aa18-9ec9ec792d95 [ 712.840942] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.841159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.841250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.841700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.841700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.841825] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d25409f-54ba-4e0d-aa18-9ec9ec792d95 already deleted. [ 712.841909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d25409f-54ba-4e0d-aa18-9ec9ec792d95" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.875328] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 185b0179-79b1-4f7f-a796-e81c3eb7726c: rpc.has_security_group_logging(os_id): False [ 712.896803] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.897306] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.897306] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.897410] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.897478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.897790] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.897850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.897894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.898304] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.898519] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.899103] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.899448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.899643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.899975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.900161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.900365] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.900650] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.900760] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.903629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.903991] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.904158] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c is going to be created. [ 712.971453] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.971453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.971453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.971453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.971802] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.986045] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.996176] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c in Status: IN_PROGRESS for 2s [ 713.086184] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.086510] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.086634] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.086951] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.087156] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.087343] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port d7166668-f516-4cce-9116-aaf6b041b040 not found, creating... [ 713.087669] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.087852] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.087991] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.088526] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.088526] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.089031] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.091207] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.091207] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.091207] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.091207] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.091207] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: d7166668-f516-4cce-9116-aaf6b041b040 is going to be created. [ 713.124147] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.124147] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.124147] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.124147] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.124147] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.124147] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-d7166668-f516-4cce-9116-aaf6b041b040" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.168895] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 713.168895] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.487740] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.487937] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.488073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.488421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.488565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.488733] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be updated. [ 713.522277] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.522519] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.522591] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.522872] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.523061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.534437] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: IN_PROGRESS for 2s [ 713.909683] env[65413]: INFO networking_nsxv3.common.synchronization [req-ba0b3c68-cc70-4336-8a83-ee703227bd56 req-aa313036-bc6c-4951-bdbd-cf7bdcfaed3c service nova] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_rules [ 713.909981] env[65413]: INFO networking_nsxv3.common.synchronization [req-ba0b3c68-cc70-4336-8a83-ee703227bd56 req-aa313036-bc6c-4951-bdbd-cf7bdcfaed3c service nova] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 713.909981] env[65413]: INFO networking_nsxv3.common.synchronization [req-ba0b3c68-cc70-4336-8a83-ee703227bd56 req-aa313036-bc6c-4951-bdbd-cf7bdcfaed3c service nova] Enqueued Resource ID: d7166668-f516-4cce-9116-aaf6b041b040 with Priority: HIGHEST for action port [ 713.910555] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_rules [ 713.910705] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 713.910806] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7166668-f516-4cce-9116-aaf6b041b040 with Priority: HIGHEST for action port [ 713.911136] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.911277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.912465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.912465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.912465] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.912702] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.912702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.912868] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7166668-f516-4cce-9116-aaf6b041b040 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.913075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7166668-f516-4cce-9116-aaf6b041b040" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.913075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7166668-f516-4cce-9116-aaf6b041b040" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.913213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7166668-f516-4cce-9116-aaf6b041b040" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.913339] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7166668-f516-4cce-9116-aaf6b041b040',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.331652] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: SUCCESS [ 714.332624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.332624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.332739] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.333263] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.393958] env[65413]: INFO networking_nsxv3.common.synchronization [req-fa0b6abd-d7ff-469d-ae57-b14070a32228 req-53d9625c-d397-41f8-ae05-b31ae4d81313 tempest-ServerGroupTestJSON-651024800 tempest-ServerGroupTestJSON-651024800-project-member] Enqueued Resource ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c with Priority: HIGHEST for action security_group_members [ 714.394223] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c with Priority: HIGHEST for action security_group_members [ 714.394745] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.395069] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.395069] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.395275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.396217] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.396217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.396217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.396217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.396217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.396490] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.416299] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.416429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.416580] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d7166668-f516-4cce-9116-aaf6b041b040 with status ACTIVE [ 714.417168] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.417168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.417168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.417323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.418327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.418327] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.418327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.418327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.418327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.418327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.418327] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.418327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.418327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.418327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.418891] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.418891] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d7166668-f516-4cce-9116-aaf6b041b040 is going to be updated. [ 714.446519] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.446693] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.446747] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.446959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.447100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.447257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7166668-f516-4cce-9116-aaf6b041b040" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.477772] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbe38081-099a-4476-a2e0-88f6c84557ca in Status: SUCCESS [ 714.479738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.479963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.480205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.480410] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.480572] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.480624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.480773] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.480883] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.480975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.481082] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bbe38081-099a-4476-a2e0-88f6c84557ca',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.552943] env[65413]: INFO networking_nsxv3.common.synchronization [None req-8cf47493-da0b-4042-94b4-b8f977024700 None None] Enqueued Resource ID: 74e2d0d9-2ec6-453f-8885-40f20f4b69ac with Priority: HIGHEST for action port [ 714.553633] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74e2d0d9-2ec6-453f-8885-40f20f4b69ac with Priority: HIGHEST for action port [ 714.554870] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-74e2d0d9-2ec6-453f-8885-40f20f4b69ac taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.555130] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74e2d0d9-2ec6-453f-8885-40f20f4b69ac" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.555232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74e2d0d9-2ec6-453f-8885-40f20f4b69ac" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.555930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74e2d0d9-2ec6-453f-8885-40f20f4b69ac" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.555930] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74e2d0d9-2ec6-453f-8885-40f20f4b69ac',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.620860] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: SUCCESS [ 714.621097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.621273] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.621495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.621693] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.621980] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.621980] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.622112] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.622112] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.622198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.622361] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.622458] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.622516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.622660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.622807] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.622911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.622952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.624279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.624389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.624615] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.624935] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.836649] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.839026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.839026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.839026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.839026] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.839026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.839026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.839026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.839026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.839026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.839026] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.898789] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.899100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.899362] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.899642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.928181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.929823] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.929823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.929823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.929823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.929823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.929823] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c is going to be updated. [ 714.979186] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.979186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.979186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.979186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.979186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.988813] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbe38081-099a-4476-a2e0-88f6c84557ca taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.988813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.988813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.988813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.988813] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.988813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.988813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.988813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.988813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.988813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.988813] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbe38081-099a-4476-a2e0-88f6c84557ca taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.988813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.988813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.988813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.988813] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.988813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.990261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.990261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.990261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.990261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.990261] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bbe38081-099a-4476-a2e0-88f6c84557ca',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.991318] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c in Status: IN_PROGRESS for 2s [ 715.020489] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c in Status: SUCCESS [ 715.020909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.059898] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74e2d0d9-2ec6-453f-8885-40f20f4b69ac [ 715.059898] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.059898] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.059898] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.060218] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.060351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.060437] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74e2d0d9-2ec6-453f-8885-40f20f4b69ac already deleted. [ 715.060533] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74e2d0d9-2ec6-453f-8885-40f20f4b69ac" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.128409] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b3bad9e-4f10-4e75-bf3f-69836f779f28: rpc.has_security_group_logging(os_id): False [ 715.152196] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.152396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.152454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.152671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.174952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.175188] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.175402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.175531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.175820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.175944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.176211] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.176331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.176405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.176596] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.176678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.176880] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.176977] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.177070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.177239] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.177283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.177371] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 is going to be updated. [ 715.258662] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.258884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.258884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.259221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.259431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.281191] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: IN_PROGRESS for 2s [ 715.328831] env[65413]: INFO networking_nsxv3.common.synchronization [req-fe1179cf-85ec-4ef7-989a-87df24444ba8 req-577b8eab-9051-4488-bbaa-de0001fcd966 tempest-SecurityGroupRulesTestJSON-1862792470 tempest-SecurityGroupRulesTestJSON-1862792470-project-member] Enqueued Resource ID: 96be0ee0-647e-49b8-8a93-da1c39d41a95 with Priority: HIGHEST for action security_group_rules [ 715.329907] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96be0ee0-647e-49b8-8a93-da1c39d41a95 with Priority: HIGHEST for action security_group_rules [ 715.330239] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96be0ee0-647e-49b8-8a93-da1c39d41a95 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.330364] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96be0ee0-647e-49b8-8a93-da1c39d41a95" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.330459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96be0ee0-647e-49b8-8a93-da1c39d41a95" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.331101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96be0ee0-647e-49b8-8a93-da1c39d41a95" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.331101] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96be0ee0-647e-49b8-8a93-da1c39d41a95',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.340727] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.340922] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.340994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.341216] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.341387] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.341480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.341543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.342051] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.342051] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.342051] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.342190] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.342238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.342301] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.342501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.342612] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.342734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.342856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.342974] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.343090] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.343302] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.343442] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.493206] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bbe38081-099a-4476-a2e0-88f6c84557ca: rpc.has_security_group_logging(os_id): False [ 715.515963] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.517487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.517487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.517487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.517487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.517487] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.517487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.517487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.517487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.517487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.517820] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.517820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.517820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.518284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.518284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.518284] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.518452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.518452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.519030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.519030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.519030] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbe38081-099a-4476-a2e0-88f6c84557ca is going to be created. [ 715.546747] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 715.547204] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.547300] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.547488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.547661] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.547783] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.547875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.547995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.548091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.548186] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.587233] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.587469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.587594] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.587827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.588365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.612087] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbe38081-099a-4476-a2e0-88f6c84557ca in Status: IN_PROGRESS for 2s [ 715.846764] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa7226ef-74d4-482f-ac1d-bbefed534583: rpc.has_security_group_logging(os_id): False [ 715.858070] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.858070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.858070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.858070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.858070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.858070] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96be0ee0-647e-49b8-8a93-da1c39d41a95 already deleted. [ 715.858070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96be0ee0-647e-49b8-8a93-da1c39d41a95" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.873078] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.873078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.873078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.873078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.873078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.873078] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.873078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.873078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.873078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.873078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.873078] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.873078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.873078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.873078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.873628] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.873628] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.873628] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.873628] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.873628] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.874031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.874031] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be updated. [ 715.984174] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.984174] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.984174] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.984174] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.984174] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.001281] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: IN_PROGRESS for 2s [ 716.051643] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.553655] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.005264] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c in Status: SUCCESS [ 717.005264] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c deletion is rescheduled due to dependency. [ 717.005264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.058065] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.058065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.058065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.058269] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.058987] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.058987] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be updated. [ 717.094070] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.094193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.094358] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.094477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.094630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.105948] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: IN_PROGRESS for 2s [ 717.138334] env[65413]: INFO networking_nsxv3.common.synchronization [None req-5e5c3d91-a50c-4f40-bb8c-b7b40dfea0f5 None None] Enqueued Resource ID: dc3182fb-0863-4666-9b99-e703cbf893ae with Priority: HIGHEST for action port [ 717.138334] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc3182fb-0863-4666-9b99-e703cbf893ae with Priority: HIGHEST for action port [ 717.138334] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc3182fb-0863-4666-9b99-e703cbf893ae taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.138334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc3182fb-0863-4666-9b99-e703cbf893ae" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.138334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc3182fb-0863-4666-9b99-e703cbf893ae" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.138334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc3182fb-0863-4666-9b99-e703cbf893ae" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.138334] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc3182fb-0863-4666-9b99-e703cbf893ae',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.308394] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: SUCCESS [ 717.308525] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.308723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.308952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.309170] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.627451] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bbe38081-099a-4476-a2e0-88f6c84557ca in Status: SUCCESS [ 717.628186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.640085] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dc3182fb-0863-4666-9b99-e703cbf893ae [ 717.640333] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.640468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.640593] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.640811] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.640906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.641010] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dc3182fb-0863-4666-9b99-e703cbf893ae already deleted. [ 717.641098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc3182fb-0863-4666-9b99-e703cbf893ae" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.818031] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.818031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.818031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.818031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.818031] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.818031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.818031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.818031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.818031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.818031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.818031] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.020258] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: SUCCESS [ 718.020558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.322173] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.322442] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.322442] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.322729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.322879] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.323014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.323098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.323498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.323498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.323498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.324669] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.324669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.324669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.324669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.324669] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.324669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.324669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.324669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.324669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.324954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.324954] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.827304] env[65413]: INFO networking_nsxv3.common.synchronization [req-5f15510b-06c0-44e2-a9b5-2c3525be74a5 req-e8d81b81-46af-4026-be96-5b73cd4e2b1f tempest-SecurityGroupRulesTestJSON-1862792470 tempest-SecurityGroupRulesTestJSON-1862792470-project-member] Enqueued Resource ID: 5011625b-eea9-4489-b5da-9e78d0489ff0 with Priority: HIGHEST for action security_group_rules [ 718.827948] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5011625b-eea9-4489-b5da-9e78d0489ff0 with Priority: HIGHEST for action security_group_rules [ 718.829833] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5011625b-eea9-4489-b5da-9e78d0489ff0 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.829833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5011625b-eea9-4489-b5da-9e78d0489ff0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.829833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5011625b-eea9-4489-b5da-9e78d0489ff0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.830091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5011625b-eea9-4489-b5da-9e78d0489ff0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.830172] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5011625b-eea9-4489-b5da-9e78d0489ff0',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.833607] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7b3bad9e-4f10-4e75-bf3f-69836f779f28: rpc.has_security_group_logging(os_id): False [ 718.857626] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.857626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.857626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.857626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.857626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.857626] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.857626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.857626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.857626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.857626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.857626] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.857626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.857626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.862033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.862033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.862033] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.862033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.862033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.862033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.862033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.862033] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 is going to be updated. [ 718.950194] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.950382] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.950452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.951451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.951451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.971185] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: IN_PROGRESS for 2s [ 719.117279] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 719.119153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.119153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.119153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.119153] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.119153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.119153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.119153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.119153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.119455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.119455] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.357065] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.357065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.357065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.357293] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.357402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.357479] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5011625b-eea9-4489-b5da-9e78d0489ff0 already deleted. [ 719.357568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5011625b-eea9-4489-b5da-9e78d0489ff0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.621805] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.622090] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.622241] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.622554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.625668] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.625862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.628139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.628381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.628477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.628638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.628872] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.629305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.629305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.629605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.629797] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.630050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.630151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.630383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.630595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.630595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.630753] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.133679] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69363ac6-cdf1-4edb-9d06-998638037b3e: rpc.has_security_group_logging(os_id): False [ 720.160298] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.160509] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.160582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.160877] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.181199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.181199] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.181440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.181440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.181599] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.181681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.181999] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.181999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.182132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.182296] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.182296] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.182423] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.182513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.182718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.182718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.182809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.182863] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be updated. [ 720.246343] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.246343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.246343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.246590] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.247368] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.274701] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: IN_PROGRESS for 2s [ 720.687439] env[65413]: INFO networking_nsxv3.common.synchronization [req-6a1d5f95-fd09-4f07-826a-139f8a13590e req-118f7d11-dba4-4a34-a6b8-790074cd7ded tempest-ImagesTestJSON-1309992501 tempest-ImagesTestJSON-1309992501-project-member] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 720.688044] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 720.688362] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.688483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.688560] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.688808] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.689584] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.689747] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.689827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.690022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.690117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.690215] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.852400] env[65413]: INFO networking_nsxv3.common.synchronization [None req-d4483507-fb0e-42fe-ba80-3dcd68beeeca None None] Enqueued Resource ID: 103eb42c-1dc9-4c18-a044-f0f5358d4c64 with Priority: HIGHEST for action port [ 720.852400] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103eb42c-1dc9-4c18-a044-f0f5358d4c64 with Priority: HIGHEST for action port [ 720.852400] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-103eb42c-1dc9-4c18-a044-f0f5358d4c64 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.852400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-103eb42c-1dc9-4c18-a044-f0f5358d4c64" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.852400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-103eb42c-1dc9-4c18-a044-f0f5358d4c64" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.852400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-103eb42c-1dc9-4c18-a044-f0f5358d4c64" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.852400] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('103eb42c-1dc9-4c18-a044-f0f5358d4c64',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.987698] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: SUCCESS [ 720.987698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.994380] env[65413]: INFO networking_nsxv3.common.synchronization [req-930b70b6-b39c-41db-8403-26b23f0852e3 req-2c75a94f-e255-4110-a159-4ea1567d2284 tempest-ServerRescueTestJSON-745679716 tempest-ServerRescueTestJSON-745679716-project-member] Enqueued Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_members [ 720.995093] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_members [ 720.995533] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42ae76b-69ae-499f-b565-4ede857c249b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.995676] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.995874] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.995963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.996161] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.996296] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.996360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.996554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.996644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.996778] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.192553] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.193326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.193326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.193326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.193326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.193326] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.196177] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.196177] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.196177] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.196177] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.196177] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 already deleted. [ 721.196177] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.358919] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 103eb42c-1dc9-4c18-a044-f0f5358d4c64 [ 721.359519] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.361205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.361326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.361653] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.361772] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.361918] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:103eb42c-1dc9-4c18-a044-f0f5358d4c64 already deleted. [ 721.362380] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-103eb42c-1dc9-4c18-a044-f0f5358d4c64" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.500238] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.927023] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-954 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.927023] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.927023] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.927023] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.927023] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.927023] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.927023] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.927023] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.927023] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.927023] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.927023] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.927023] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.927917] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.928671] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.928933] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.929231] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.952373] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.952373] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.952373] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.952373] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.952565] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-bcb58175-01b6-401c-9209-6d7de349d8ad taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.954157] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-bcb58175-01b6-401c-9209-6d7de349d8ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.954157] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-bcb58175-01b6-401c-9209-6d7de349d8ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.954157] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-bcb58175-01b6-401c-9209-6d7de349d8ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.954157] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb58175-01b6-401c-9209-6d7de349d8ad',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.003067] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.293998] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 722.294325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.455897] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.456122] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.456240] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.456529] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.456661] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.456805] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port bcb58175-01b6-401c-9209-6d7de349d8ad not found, creating... [ 722.457316] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.457316] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.457316] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.460283] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.460283] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.460283] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.460283] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.460283] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.460283] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.460283] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.460283] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: bcb58175-01b6-401c-9209-6d7de349d8ad is going to be created. [ 722.482050] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.482518] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.482518] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.482785] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.483060] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.483754] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-bcb58175-01b6-401c-9209-6d7de349d8ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.505523] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.505685] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.505746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.505956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.506062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.506163] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c42ae76b-69ae-499f-b565-4ede857c249b is going to be updated. [ 722.628980] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.629198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.629243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.629447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.629582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.639997] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c42ae76b-69ae-499f-b565-4ede857c249b in Status: IN_PROGRESS for 2s [ 723.206049] env[65413]: INFO networking_nsxv3.common.synchronization [req-6a1d5f95-fd09-4f07-826a-139f8a13590e req-bfc7f5c3-e325-4502-81c6-2c9f4e8b3bf9 service nova] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_rules [ 723.206049] env[65413]: INFO networking_nsxv3.common.synchronization [req-6a1d5f95-fd09-4f07-826a-139f8a13590e req-bfc7f5c3-e325-4502-81c6-2c9f4e8b3bf9 service nova] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 723.206306] env[65413]: INFO networking_nsxv3.common.synchronization [req-6a1d5f95-fd09-4f07-826a-139f8a13590e req-bfc7f5c3-e325-4502-81c6-2c9f4e8b3bf9 service nova] Enqueued Resource ID: bcb58175-01b6-401c-9209-6d7de349d8ad with Priority: HIGHEST for action port [ 723.206446] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_rules [ 723.206560] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 723.206663] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bcb58175-01b6-401c-9209-6d7de349d8ad with Priority: HIGHEST for action port [ 723.208087] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.208087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.208087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.208283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.208283] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.209358] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.209473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.209542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.209741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.209892] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.209988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.210066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.210460] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.210563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.210726] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.211760] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-bcb58175-01b6-401c-9209-6d7de349d8ad taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.211869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bcb58175-01b6-401c-9209-6d7de349d8ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.211938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bcb58175-01b6-401c-9209-6d7de349d8ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.212116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bcb58175-01b6-401c-9209-6d7de349d8ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.212200] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bcb58175-01b6-401c-9209-6d7de349d8ad',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.594185] env[65413]: INFO networking_nsxv3.common.synchronization [None req-6b635863-5cb1-4862-a064-40ba19eb9064 None None] Enqueued Resource ID: 7493d630-24fe-47cd-8ac0-508ce7b28a90 with Priority: HIGHEST for action port [ 723.594914] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7493d630-24fe-47cd-8ac0-508ce7b28a90 with Priority: HIGHEST for action port [ 723.595115] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-7493d630-24fe-47cd-8ac0-508ce7b28a90 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.595239] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7493d630-24fe-47cd-8ac0-508ce7b28a90" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.595519] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7493d630-24fe-47cd-8ac0-508ce7b28a90" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.595601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7493d630-24fe-47cd-8ac0-508ce7b28a90" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.595641] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7493d630-24fe-47cd-8ac0-508ce7b28a90',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.714399] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.714399] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.714399] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.715404] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bcb58175-01b6-401c-9209-6d7de349d8ad with status ACTIVE [ 723.715586] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.715750] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.715750] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.715960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.716061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.716228] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.716734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.716734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.716734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.716734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.716974] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.716974] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.716974] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.717149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.717149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.717249] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bcb58175-01b6-401c-9209-6d7de349d8ad is going to be updated. [ 723.740076] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.740246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.740309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.740504] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.740639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.740831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bcb58175-01b6-401c-9209-6d7de349d8ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.098652] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7493d630-24fe-47cd-8ac0-508ce7b28a90 [ 724.098652] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.098652] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.098652] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.099849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.100137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.100626] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7493d630-24fe-47cd-8ac0-508ce7b28a90 already deleted. [ 724.100626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7493d630-24fe-47cd-8ac0-508ce7b28a90" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.220135] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.652607] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c42ae76b-69ae-499f-b565-4ede857c249b in Status: SUCCESS [ 724.653414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.725711] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.728478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.728478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.728478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.728478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.728478] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be created. [ 724.774822] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.774822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.774822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.774822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.775631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.788904] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: UNINITIALIZED for 2s [ 725.051520] env[65413]: INFO networking_nsxv3.common.synchronization [req-f9907117-d0c2-4704-b828-3f9534ed26dc req-692ae5b1-7d46-4d55-909c-8e8a1f3cbd64 tempest-MigrationsAdminTest-1569866777 tempest-MigrationsAdminTest-1569866777-project-member] Enqueued Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_members [ 725.054326] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_members [ 725.058562] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.058765] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.058921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.059884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.059884] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.059884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.059884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.060160] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.064176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.064306] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.567282] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.602748] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.603052] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.603232] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.603581] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.603908] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.604170] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.604343] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.604614] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.604805] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.605073] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.605235] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.605382] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.605527] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.605677] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.605905] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.606100] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.631430] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.631430] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 725.631691] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.632203] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.632203] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-4c5ca920-6538-464a-81cc-d3b41e3c055c taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.633479] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-4c5ca920-6538-464a-81cc-d3b41e3c055c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.633693] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-4c5ca920-6538-464a-81cc-d3b41e3c055c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.634707] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-4c5ca920-6538-464a-81cc-d3b41e3c055c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.634864] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c5ca920-6538-464a-81cc-d3b41e3c055c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.069862] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.138023] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.138510] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.138510] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.139190] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.139190] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.139515] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 4c5ca920-6538-464a-81cc-d3b41e3c055c not found, creating... [ 726.139705] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.140620] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.140620] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.140620] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.140620] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.140797] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.141537] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.141537] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.141537] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.141701] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.141934] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 4c5ca920-6538-464a-81cc-d3b41e3c055c is going to be created. [ 726.166350] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.166646] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.168030] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.168030] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.168030] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.168030] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-4c5ca920-6538-464a-81cc-d3b41e3c055c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.572028] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.572244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.572244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.572679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.572679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.572679] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af248d88-efaa-44cd-99ca-972413455b63 is going to be updated. [ 726.605246] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.606502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.606630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.606876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.607049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.618356] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: IN_PROGRESS for 2s [ 726.785647] env[65413]: INFO networking_nsxv3.common.synchronization [None req-b55ed9c6-7c68-4b37-b819-ffc3df91d694 None None] Enqueued Resource ID: 68db2d92-ee00-4f81-b8a1-82d0999b0cb5 with Priority: HIGHEST for action port [ 726.786889] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68db2d92-ee00-4f81-b8a1-82d0999b0cb5 with Priority: HIGHEST for action port [ 726.787260] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-68db2d92-ee00-4f81-b8a1-82d0999b0cb5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.787396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68db2d92-ee00-4f81-b8a1-82d0999b0cb5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.787473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68db2d92-ee00-4f81-b8a1-82d0999b0cb5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.787781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68db2d92-ee00-4f81-b8a1-82d0999b0cb5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.787866] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68db2d92-ee00-4f81-b8a1-82d0999b0cb5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.803863] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 726.803863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.803863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.803863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.803863] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.804511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.804684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.805020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.805244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.805454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.806628] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.924068] env[65413]: INFO networking_nsxv3.common.synchronization [req-f9907117-d0c2-4704-b828-3f9534ed26dc req-76b02052-0074-429a-b2cf-ee775f97ef10 service nova] Enqueued Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_rules [ 726.924278] env[65413]: INFO networking_nsxv3.common.synchronization [req-f9907117-d0c2-4704-b828-3f9534ed26dc req-76b02052-0074-429a-b2cf-ee775f97ef10 service nova] Enqueued Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_members [ 726.924511] env[65413]: INFO networking_nsxv3.common.synchronization [req-f9907117-d0c2-4704-b828-3f9534ed26dc req-76b02052-0074-429a-b2cf-ee775f97ef10 service nova] Enqueued Resource ID: 4c5ca920-6538-464a-81cc-d3b41e3c055c with Priority: HIGHEST for action port [ 726.927491] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_rules [ 726.927687] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_members [ 726.927819] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c5ca920-6538-464a-81cc-d3b41e3c055c with Priority: HIGHEST for action port [ 726.928181] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.931025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.931025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.931025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.931025] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.931025] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.931025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.931025] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c5ca920-6538-464a-81cc-d3b41e3c055c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.931025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c5ca920-6538-464a-81cc-d3b41e3c055c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.931025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c5ca920-6538-464a-81cc-d3b41e3c055c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.931025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c5ca920-6538-464a-81cc-d3b41e3c055c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.931025] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c5ca920-6538-464a-81cc-d3b41e3c055c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.264329] env[65413]: INFO networking_nsxv3.common.synchronization [req-ccdbfb53-cc22-46fb-8379-6054a3f721dc req-9498261e-97f3-4b0d-81a2-63d65945e3aa tempest-MultipleCreateTestJSON-1512040954 tempest-MultipleCreateTestJSON-1512040954-project-member] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 727.267047] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 727.267047] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.267047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.267047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.267304] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.267478] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.267592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.267965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.267965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.267965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.268118] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.294659] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68db2d92-ee00-4f81-b8a1-82d0999b0cb5 [ 727.294771] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.294921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.295008] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.295229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.295416] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.295466] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68db2d92-ee00-4f81-b8a1-82d0999b0cb5 already deleted. [ 727.295531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68db2d92-ee00-4f81-b8a1-82d0999b0cb5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.311289] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.311440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.311504] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.311721] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.311885] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.311986] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.312129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.312238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.312332] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.312420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.312598] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.312651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.312707] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.312844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.312979] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.313106] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.313168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.313313] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.313375] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.313454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.313756] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.432917] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.433069] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.433262] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c5ca920-6538-464a-81cc-d3b41e3c055c with status ACTIVE [ 727.433429] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.433616] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.433616] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.434495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.434495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.434495] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.434495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.434495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.434495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.434495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.434716] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.434716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.434716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.434822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.434855] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.434931] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c5ca920-6538-464a-81cc-d3b41e3c055c is going to be updated. [ 727.465167] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.465354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.465429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.465645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.465779] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.465981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c5ca920-6538-464a-81cc-d3b41e3c055c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.770825] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.793760] env[65413]: INFO networking_nsxv3.common.synchronization [req-9231dda6-a4ef-421d-9b0b-4b2afbc3ed2f req-e93fe22c-d439-4d83-a47f-b6e3d5df1e93 tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 with Priority: HIGHEST for action security_group_members [ 727.794279] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 with Priority: HIGHEST for action security_group_members [ 727.794587] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.794704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.794767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.795109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.795284] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.795386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.795446] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.795609] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.795687] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.795799] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b9c29e6-4adf-4695-9f0a-75daeb6daeb9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.817600] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 650f4003-0da8-43a0-bfde-c7d15e589861: rpc.has_security_group_logging(os_id): False [ 727.843373] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.843373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.843373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.843373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.843373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.843373] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.843373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.843373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.843373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.843373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.843373] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.843373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.843373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.843373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.843925] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.843925] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.843925] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.843925] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.844072] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.844144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.844261] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be created. [ 727.910230] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.910499] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.910555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.911094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.913054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.922931] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 728.273367] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.298221] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.298375] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.298449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.298706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.299110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.299252] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.299382] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.299519] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.299812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.299926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.300136] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 already deleted. [ 728.300246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.525610] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-210 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.525745] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.525956] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.526425] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.526642] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.526800] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.526908] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.527148] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.527302] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.527480] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.527582] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 728.527713] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 728.527856] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 728.527961] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 728.528077] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 728.528203] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.549210] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.549359] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.549398] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.549564] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.550093] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-986c2835-9027-4f56-a988-0d68c0d595b4 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.550430] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-986c2835-9027-4f56-a988-0d68c0d595b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.550430] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-986c2835-9027-4f56-a988-0d68c0d595b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.550685] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-986c2835-9027-4f56-a988-0d68c0d595b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.550822] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('986c2835-9027-4f56-a988-0d68c0d595b4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.632121] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: SUCCESS [ 728.632352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.632527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.632763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.632954] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.633107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.633148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.633303] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.633380] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.633475] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.777764] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.777957] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.778053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.778281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.778382] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.778472] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be updated. [ 728.815526] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.815704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.815743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.815940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.817546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.827931] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: IN_PROGRESS for 2s [ 728.832547] env[65413]: INFO networking_nsxv3.common.synchronization [None req-bb378092-d83c-4b52-9de3-43732ca4e9ff tempest-ServersTestFqdnHostnames-958389924 tempest-ServersTestFqdnHostnames-958389924-project-member] Enqueued Resource ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 with Priority: HIGHEST for action security_group_rules [ 728.832547] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 with Priority: HIGHEST for action security_group_rules [ 728.832547] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0022fbcd-322d-4db7-a1a1-6693d137e213 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.832547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.832547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.832868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.833081] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0022fbcd-322d-4db7-a1a1-6693d137e213',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.054490] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.054490] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.054490] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.054735] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.054735] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.054852] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 986c2835-9027-4f56-a988-0d68c0d595b4 not found, creating... [ 729.055116] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.055292] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.055399] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.055622] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.055750] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.056383] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.056540] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.056650] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.056860] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.056982] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.057368] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 986c2835-9027-4f56-a988-0d68c0d595b4 is going to be created. [ 729.083908] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.083908] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.083908] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.084174] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.084381] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.084595] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-986c2835-9027-4f56-a988-0d68c0d595b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.136665] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.286233] env[65413]: INFO networking_nsxv3.common.synchronization [None req-bfc1540e-a713-488d-9ad2-8be0f5cc5128 None None] Enqueued Resource ID: 08f679c4-b7b2-4978-accd-7ecb6dc9c651 with Priority: HIGHEST for action port [ 729.286808] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08f679c4-b7b2-4978-accd-7ecb6dc9c651 with Priority: HIGHEST for action port [ 729.287129] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-08f679c4-b7b2-4978-accd-7ecb6dc9c651 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.287445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08f679c4-b7b2-4978-accd-7ecb6dc9c651" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.287445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08f679c4-b7b2-4978-accd-7ecb6dc9c651" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.287621] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08f679c4-b7b2-4978-accd-7ecb6dc9c651" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.287841] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08f679c4-b7b2-4978-accd-7ecb6dc9c651',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.356336] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.356534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.356605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.356834] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.356963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.357120] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 already deleted. [ 729.357295] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.434445] env[65413]: INFO networking_nsxv3.common.synchronization [None req-32f800c0-b10b-4df1-a17b-019ec82a8c70 None None] Enqueued Resource ID: 71ffb479-aa7a-4fe5-9131-1dab9f488e8d with Priority: HIGHEST for action port [ 729.434699] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71ffb479-aa7a-4fe5-9131-1dab9f488e8d with Priority: HIGHEST for action port [ 729.437696] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-71ffb479-aa7a-4fe5-9131-1dab9f488e8d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.437881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71ffb479-aa7a-4fe5-9131-1dab9f488e8d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.437964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71ffb479-aa7a-4fe5-9131-1dab9f488e8d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.438298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71ffb479-aa7a-4fe5-9131-1dab9f488e8d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.438384] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71ffb479-aa7a-4fe5-9131-1dab9f488e8d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.641083] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.791510] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 08f679c4-b7b2-4978-accd-7ecb6dc9c651 [ 729.791761] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.791920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.791992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.792227] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.792352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.792496] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:08f679c4-b7b2-4978-accd-7ecb6dc9c651 already deleted. [ 729.792541] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08f679c4-b7b2-4978-accd-7ecb6dc9c651" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.793449] env[65413]: INFO networking_nsxv3.common.synchronization [req-9231dda6-a4ef-421d-9b0b-4b2afbc3ed2f req-ac831318-c1ec-40ac-bc3d-e72dbbb5f380 service nova] Enqueued Resource ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 with Priority: HIGHEST for action security_group_rules [ 729.793547] env[65413]: INFO networking_nsxv3.common.synchronization [req-9231dda6-a4ef-421d-9b0b-4b2afbc3ed2f req-ac831318-c1ec-40ac-bc3d-e72dbbb5f380 service nova] Enqueued Resource ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 with Priority: HIGHEST for action security_group_members [ 729.793677] env[65413]: INFO networking_nsxv3.common.synchronization [req-9231dda6-a4ef-421d-9b0b-4b2afbc3ed2f req-ac831318-c1ec-40ac-bc3d-e72dbbb5f380 service nova] Enqueued Resource ID: 986c2835-9027-4f56-a988-0d68c0d595b4 with Priority: HIGHEST for action port [ 729.798302] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 with Priority: HIGHEST for action security_group_rules [ 729.798302] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 with Priority: HIGHEST for action security_group_members [ 729.798302] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 986c2835-9027-4f56-a988-0d68c0d595b4 with Priority: HIGHEST for action port [ 729.798302] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.798302] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.798302] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.798302] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.798302] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b9c29e6-4adf-4695-9f0a-75daeb6daeb9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.798598] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.798641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.798775] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.798910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.800050] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.800203] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.800291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.800481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.800585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.800700] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b9c29e6-4adf-4695-9f0a-75daeb6daeb9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.802440] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-986c2835-9027-4f56-a988-0d68c0d595b4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.802572] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-986c2835-9027-4f56-a988-0d68c0d595b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.802636] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-986c2835-9027-4f56-a988-0d68c0d595b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.802785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-986c2835-9027-4f56-a988-0d68c0d595b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.802967] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('986c2835-9027-4f56-a988-0d68c0d595b4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.932113] env[65413]: INFO networking_nsxv3.common.synchronization [None req-18764e12-f5e1-457e-b9ef-cd432559690a tempest-ServersTestFqdnHostnames-958389924 tempest-ServersTestFqdnHostnames-958389924-project-member] Enqueued Resource ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 with Priority: HIGHEST for action security_group_rules [ 729.932669] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 with Priority: HIGHEST for action security_group_rules [ 729.934114] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0022fbcd-322d-4db7-a1a1-6693d137e213 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.934114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.934114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.934114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.935630] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0022fbcd-322d-4db7-a1a1-6693d137e213',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.939869] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 729.940330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.941286] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71ffb479-aa7a-4fe5-9131-1dab9f488e8d [ 729.941636] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.942157] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.942400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.942702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.942964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.943172] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71ffb479-aa7a-4fe5-9131-1dab9f488e8d already deleted. [ 729.943343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71ffb479-aa7a-4fe5-9131-1dab9f488e8d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.143789] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.144020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.145024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.145024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.145024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.145024] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af248d88-efaa-44cd-99ca-972413455b63 is going to be updated. [ 730.197522] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.197682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.197751] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.197987] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.198150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.211778] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: IN_PROGRESS for 2s [ 730.305130] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.305422] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.305550] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9b9c29e6-4adf-4695-9f0a-75daeb6daeb9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.306596] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 986c2835-9027-4f56-a988-0d68c0d595b4 with status ACTIVE [ 730.306806] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.306930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.307011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.307337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.307454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.307651] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.307845] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.307845] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.308087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.308193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.308404] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.308491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.308610] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.308705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.308781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.308866] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 986c2835-9027-4f56-a988-0d68c0d595b4 is going to be updated. [ 730.353073] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.353283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.353283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.353545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.353744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.353999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-986c2835-9027-4f56-a988-0d68c0d595b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.582925] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.583182] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.583255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.583498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.583607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.583816] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 already deleted. [ 730.583889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.811762] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9b9c29e6-4adf-4695-9f0a-75daeb6daeb9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.850617] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: SUCCESS [ 730.850617] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.315276] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.315818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.315818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.315818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.315818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.315818] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 is going to be created. [ 731.370428] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.370428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.370428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.370975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.371237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.383990] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 in Status: UNINITIALIZED for 2s [ 732.085742] env[65413]: INFO networking_nsxv3.common.synchronization [req-f47fe56b-db6e-47ed-bcc5-5ed3a67b9eb2 req-31702e49-694e-441f-86fb-4a1544b25725 tempest-ServerRescueTestJSONUnderV235-958519432 tempest-ServerRescueTestJSONUnderV235-958519432-project-member] Enqueued Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_members [ 732.086372] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGHEST for action security_group_members [ 732.086739] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.086896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.086973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.087911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.088101] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.088180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.088252] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.088432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.089067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.089203] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.226229] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: SUCCESS [ 732.226229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.226229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.226229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.226229] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.226229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.226229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.226229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.226229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.226229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.226229] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.235038] env[65413]: INFO networking_nsxv3.common.synchronization [None req-e2f026b9-e883-4320-ad71-8166a8703efc None None] Enqueued Resource ID: 4c9af646-35ba-4644-a13f-ffa01954fd2d with Priority: HIGHEST for action port [ 732.235038] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c9af646-35ba-4644-a13f-ffa01954fd2d with Priority: HIGHEST for action port [ 732.235038] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c9af646-35ba-4644-a13f-ffa01954fd2d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.235038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c9af646-35ba-4644-a13f-ffa01954fd2d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.235038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c9af646-35ba-4644-a13f-ffa01954fd2d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.235038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c9af646-35ba-4644-a13f-ffa01954fd2d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.235038] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c9af646-35ba-4644-a13f-ffa01954fd2d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.336240] env[65413]: INFO networking_nsxv3.common.synchronization [req-77795f04-5a80-4fe8-8875-8bc2f8a382f3 req-539453b4-c12d-42a9-a4fa-32830ebff43e tempest-MultipleCreateTestJSON-1512040954 tempest-MultipleCreateTestJSON-1512040954-project-member] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 732.336240] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGHEST for action security_group_members [ 732.336240] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.336240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.336240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.337281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.337677] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.339495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.339495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.339495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.339495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.339495] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.430041] env[65413]: INFO networking_nsxv3.common.synchronization [None req-84b199d0-8911-45b1-a7bb-22f004b5c0a9 tempest-AttachInterfacesUnderV243Test-1674623919 tempest-AttachInterfacesUnderV243Test-1674623919-project-member] Enqueued Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_rules [ 732.430712] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_rules [ 732.431699] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.432110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.432272] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.432576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.432657] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.592618] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.593071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.593071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.593071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.593260] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.593369] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.593508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.593578] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.593750] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.593939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.593939] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 is going to be updated. [ 732.627059] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.627059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.627474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.627785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.627977] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.640538] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: IN_PROGRESS for 2s [ 732.733968] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.734140] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.734186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.734525] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.734830] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.734974] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.735048] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.735302] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.735432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.735521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.735754] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.735862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.735919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.736095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.736246] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.736346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.736402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.736535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.736634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.736718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.736812] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.737959] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c9af646-35ba-4644-a13f-ffa01954fd2d [ 732.739103] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.739103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.739250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.739380] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.739664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.739664] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c9af646-35ba-4644-a13f-ffa01954fd2d already deleted. [ 732.740183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c9af646-35ba-4644-a13f-ffa01954fd2d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.843123] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.843123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.843123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.843123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.843123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.843123] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.843123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.843123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.843123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.843123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.843123] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be updated. [ 732.876847] env[65413]: INFO networking_nsxv3.common.synchronization [None req-8f3a3f28-a0a4-4cf2-83ec-97bac422a9f5 tempest-AttachInterfacesUnderV243Test-1674623919 tempest-AttachInterfacesUnderV243Test-1674623919-project-member] Enqueued Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_rules [ 732.878396] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.878578] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.878640] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.878914] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.879145] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.883861] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_rules [ 732.884669] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.884805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.898148] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: IN_PROGRESS for 2s [ 732.960130] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.960375] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.960562] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.960952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.961147] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.961610] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b already deleted. [ 732.961610] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.961750] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.962229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.962229] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.241458] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af248d88-efaa-44cd-99ca-972413455b63: rpc.has_security_group_logging(os_id): False [ 733.260466] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.260812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.260812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.261149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.284174] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.284697] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.284822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.284892] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.285140] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.285228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.285431] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.285533] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.285606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.285761] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.285837] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.286413] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.286616] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.286616] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.286778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.286856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.286945] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af248d88-efaa-44cd-99ca-972413455b63 is going to be updated. [ 733.378626] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.379032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.379032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.379103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.379313] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.399947] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 in Status: SUCCESS [ 733.400274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.400868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.401104] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.401331] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.401890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.401890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.401890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.401890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.401890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.402160] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9b9c29e6-4adf-4695-9f0a-75daeb6daeb9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.405241] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: IN_PROGRESS for 2s [ 733.485871] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.488490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.488490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.488490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.488490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.488490] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b already deleted. [ 733.488490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.907192] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9b9c29e6-4adf-4695-9f0a-75daeb6daeb9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.031389] env[65413]: INFO networking_nsxv3.common.synchronization [None req-26fa7c42-6ee9-4162-b706-288753f0711d tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGHEST for action security_group_rules [ 734.031821] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGHEST for action security_group_rules [ 734.032159] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.032406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.032406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.032640] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.032697] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcfdc2e3-2cc7-44cc-8355-9f87d267f435',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.076539] env[65413]: INFO networking_nsxv3.common.synchronization [req-7ce9e795-2b90-4d33-88bf-0476eb6f78a6 req-612e66e1-6992-4af3-ab47-4be65db28643 tempest-InstanceActionsV221TestJSON-1964290210 tempest-InstanceActionsV221TestJSON-1964290210-project-member] Enqueued Resource ID: bbe38081-099a-4476-a2e0-88f6c84557ca with Priority: HIGHEST for action security_group_members [ 734.077123] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbe38081-099a-4476-a2e0-88f6c84557ca with Priority: HIGHEST for action security_group_members [ 734.077585] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-bbe38081-099a-4476-a2e0-88f6c84557ca taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.077973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.078085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.079295] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.079475] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.079595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.080975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.080975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.080975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.080975] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bbe38081-099a-4476-a2e0-88f6c84557ca',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.413646] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9: rpc.has_security_group_logging(os_id): False [ 734.436032] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.436032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.436032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.436032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.436032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.436032] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.436032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.436032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.436032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.436032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.436032] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 is going to be created. [ 734.509260] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.509356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.510263] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.510263] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.510263] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.528169] env[65413]: INFO networking_nsxv3.common.synchronization [None req-a64a780d-af0a-4ccd-a9ed-c6f3f6547425 None None] Enqueued Resource ID: cb4dbc35-8323-43ce-b2fc-ee0fe250480c with Priority: HIGHEST for action port [ 734.528169] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb4dbc35-8323-43ce-b2fc-ee0fe250480c with Priority: HIGHEST for action port [ 734.528169] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-cb4dbc35-8323-43ce-b2fc-ee0fe250480c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.528169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cb4dbc35-8323-43ce-b2fc-ee0fe250480c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.529498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cb4dbc35-8323-43ce-b2fc-ee0fe250480c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.529926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cb4dbc35-8323-43ce-b2fc-ee0fe250480c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.530293] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cb4dbc35-8323-43ce-b2fc-ee0fe250480c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.535967] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 in Status: IN_PROGRESS for 2s [ 734.561517] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.561517] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.561517] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.561517] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.561517] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.561517] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 already deleted. [ 734.561517] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.586030] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.586030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.586030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.586030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.586030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.586030] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.586030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.586030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.586030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.586030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.586030] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbe38081-099a-4476-a2e0-88f6c84557ca is going to be updated. [ 734.636025] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.636025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.636025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.636025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.636025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.648510] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbe38081-099a-4476-a2e0-88f6c84557ca in Status: IN_PROGRESS for 2s [ 734.651339] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 in Status: SUCCESS [ 734.651522] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 deletion is rescheduled due to dependency. [ 734.652303] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.667170] env[65413]: INFO networking_nsxv3.common.synchronization [None req-a113a966-fd7c-42ee-8179-ce5e65cf237f tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGHEST for action security_group_rules [ 734.667939] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGHEST for action security_group_rules [ 734.668153] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.668270] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.668334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.668537] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.668612] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcfdc2e3-2cc7-44cc-8355-9f87d267f435',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.909567] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa7226ef-74d4-482f-ac1d-bbefed534583 in Status: SUCCESS [ 734.909762] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 deletion is rescheduled due to dependency. [ 734.909912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.033094] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cb4dbc35-8323-43ce-b2fc-ee0fe250480c [ 735.033441] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.033707] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.033707] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.033931] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.034035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.034139] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cb4dbc35-8323-43ce-b2fc-ee0fe250480c already deleted. [ 735.034238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cb4dbc35-8323-43ce-b2fc-ee0fe250480c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.193391] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.193603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.193603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.193738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.193846] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.194020] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 already deleted. [ 735.194220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.427147] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: SUCCESS [ 735.427147] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.185156] env[65413]: INFO networking_nsxv3.common.synchronization [req-eb1852fe-382f-4da2-a6d1-050e7f21e121 req-24b032ed-99eb-486e-8994-6b9302f35a25 tempest-ServersAdminNegativeTestJSON-1139809485 tempest-ServersAdminNegativeTestJSON-1139809485-project-member] Enqueued Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_members [ 736.185156] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_members [ 736.186589] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5899503-b7f8-4b26-9b77-05fdacbf5c20 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.186589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.187346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.187346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.187346] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.187346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.187346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.188559] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.188559] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.188559] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.472794] env[65413]: INFO networking_nsxv3.common.synchronization [req-11aa1785-6cf7-4776-ab92-bda8da2308d4 req-78ddf222-c726-4a38-8daa-e754de3dde9a tempest-SecurityGroupRulesTestJSON-1862792470 tempest-SecurityGroupRulesTestJSON-1862792470-project-member] Enqueued Resource ID: 3c7c1c18-4ee9-4f6d-be0a-e1c02ef745c1 with Priority: HIGHEST for action security_group_rules [ 736.473391] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3c7c1c18-4ee9-4f6d-be0a-e1c02ef745c1 with Priority: HIGHEST for action security_group_rules [ 736.473711] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3c7c1c18-4ee9-4f6d-be0a-e1c02ef745c1 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.473884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3c7c1c18-4ee9-4f6d-be0a-e1c02ef745c1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.473915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3c7c1c18-4ee9-4f6d-be0a-e1c02ef745c1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.475593] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3c7c1c18-4ee9-4f6d-be0a-e1c02ef745c1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.475593] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3c7c1c18-4ee9-4f6d-be0a-e1c02ef745c1',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.552617] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 in Status: SUCCESS [ 736.552617] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.659494] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bbe38081-099a-4476-a2e0-88f6c84557ca in Status: SUCCESS [ 736.659672] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bbe38081-099a-4476-a2e0-88f6c84557ca deletion is rescheduled due to dependency. [ 736.659786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.691929] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.832918] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-845 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.833165] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.833261] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.833530] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.833837] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.834157] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.834325] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.834592] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.834752] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.835180] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.835274] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.835373] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.835477] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.836156] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.836306] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.836449] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.861021] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.861021] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 736.861021] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.861021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-845" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.861021] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-64fa37bf-b60d-4098-9e27-2b7a4436306d taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.861021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-64fa37bf-b60d-4098-9e27-2b7a4436306d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.861021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-64fa37bf-b60d-4098-9e27-2b7a4436306d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.861021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-64fa37bf-b60d-4098-9e27-2b7a4436306d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.861021] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64fa37bf-b60d-4098-9e27-2b7a4436306d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.996238] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.996238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.996238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.996238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.996238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.996238] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3c7c1c18-4ee9-4f6d-be0a-e1c02ef745c1 already deleted. [ 736.996238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3c7c1c18-4ee9-4f6d-be0a-e1c02ef745c1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.073814] env[65413]: INFO networking_nsxv3.common.synchronization [None req-1b07b35e-d620-4267-a496-e72b6030280a None None] Enqueued Resource ID: aad32339-87fb-4ff0-9f8d-1a49926a96f0 with Priority: HIGHEST for action port [ 737.074367] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aad32339-87fb-4ff0-9f8d-1a49926a96f0 with Priority: HIGHEST for action port [ 737.074657] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-aad32339-87fb-4ff0-9f8d-1a49926a96f0 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.074774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aad32339-87fb-4ff0-9f8d-1a49926a96f0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.074842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aad32339-87fb-4ff0-9f8d-1a49926a96f0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.075231] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aad32339-87fb-4ff0-9f8d-1a49926a96f0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.075315] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aad32339-87fb-4ff0-9f8d-1a49926a96f0',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.195767] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.243831] env[65413]: INFO networking_nsxv3.common.synchronization [None req-8867f036-a2fd-41ff-8ceb-e11598f3f017 tempest-ImagesOneServerNegativeTestJSON-1663656844 tempest-ImagesOneServerNegativeTestJSON-1663656844-project-member] Enqueued Resource ID: 14a26ad4-6d48-452a-8053-8cb9475751eb with Priority: HIGHEST for action security_group_rules [ 737.244581] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14a26ad4-6d48-452a-8053-8cb9475751eb with Priority: HIGHEST for action security_group_rules [ 737.244642] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14a26ad4-6d48-452a-8053-8cb9475751eb taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.245077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14a26ad4-6d48-452a-8053-8cb9475751eb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.245077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14a26ad4-6d48-452a-8053-8cb9475751eb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.245148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14a26ad4-6d48-452a-8053-8cb9475751eb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.245192] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14a26ad4-6d48-452a-8053-8cb9475751eb',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.367020] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.367020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.367020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.367020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.367020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.367020] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 64fa37bf-b60d-4098-9e27-2b7a4436306d not found, creating... [ 737.367020] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.367020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.367020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.367020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.367020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.367522] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.367522] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.367522] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.370448] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.372247] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.372247] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 64fa37bf-b60d-4098-9e27-2b7a4436306d is going to be created. [ 737.394060] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.396220] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.396220] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.396220] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.396220] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.396220] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-64fa37bf-b60d-4098-9e27-2b7a4436306d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.577717] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port aad32339-87fb-4ff0-9f8d-1a49926a96f0 [ 737.578012] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.578170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.578204] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.578442] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.578560] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.578655] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:aad32339-87fb-4ff0-9f8d-1a49926a96f0 already deleted. [ 737.578740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aad32339-87fb-4ff0-9f8d-1a49926a96f0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.669103] env[65413]: INFO networking_nsxv3.common.synchronization [None req-73d95685-b1fd-4af6-8112-e12da4c21970 tempest-ImagesOneServerNegativeTestJSON-1663656844 tempest-ImagesOneServerNegativeTestJSON-1663656844-project-member] Enqueued Resource ID: 14a26ad4-6d48-452a-8053-8cb9475751eb with Priority: HIGHEST for action security_group_rules [ 737.669639] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14a26ad4-6d48-452a-8053-8cb9475751eb with Priority: HIGHEST for action security_group_rules [ 737.670440] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14a26ad4-6d48-452a-8053-8cb9475751eb taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.670440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14a26ad4-6d48-452a-8053-8cb9475751eb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.699123] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.699274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.699350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.699592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.699664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.699760] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 is going to be updated. [ 737.732848] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.733121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.733253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.733510] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.733664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.746427] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 in Status: IN_PROGRESS for 2s [ 737.770551] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.770722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.770775] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.771500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.771500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.771500] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14a26ad4-6d48-452a-8053-8cb9475751eb already deleted. [ 737.771500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14a26ad4-6d48-452a-8053-8cb9475751eb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.771500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14a26ad4-6d48-452a-8053-8cb9475751eb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.771730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14a26ad4-6d48-452a-8053-8cb9475751eb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.771730] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14a26ad4-6d48-452a-8053-8cb9475751eb',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.279811] env[65413]: INFO networking_nsxv3.common.synchronization [req-eb1852fe-382f-4da2-a6d1-050e7f21e121 req-063a6d2b-50ee-4f9c-aa65-ad9852e6126d service nova] Enqueued Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_rules [ 738.280871] env[65413]: INFO networking_nsxv3.common.synchronization [req-eb1852fe-382f-4da2-a6d1-050e7f21e121 req-063a6d2b-50ee-4f9c-aa65-ad9852e6126d service nova] Enqueued Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_members [ 738.281213] env[65413]: INFO networking_nsxv3.common.synchronization [req-eb1852fe-382f-4da2-a6d1-050e7f21e121 req-063a6d2b-50ee-4f9c-aa65-ad9852e6126d service nova] Enqueued Resource ID: 64fa37bf-b60d-4098-9e27-2b7a4436306d with Priority: HIGHEST for action port [ 738.281756] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_rules [ 738.281898] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_members [ 738.282284] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64fa37bf-b60d-4098-9e27-2b7a4436306d with Priority: HIGHEST for action port [ 738.282482] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5899503-b7f8-4b26-9b77-05fdacbf5c20 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.282610] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.282676] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.282889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.282974] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.284646] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5899503-b7f8-4b26-9b77-05fdacbf5c20 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.285494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.285750] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-64fa37bf-b60d-4098-9e27-2b7a4436306d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.285864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64fa37bf-b60d-4098-9e27-2b7a4436306d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.285963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64fa37bf-b60d-4098-9e27-2b7a4436306d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.286146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64fa37bf-b60d-4098-9e27-2b7a4436306d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.286234] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64fa37bf-b60d-4098-9e27-2b7a4436306d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.295154] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.295292] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.295397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.295681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.295822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.295942] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14a26ad4-6d48-452a-8053-8cb9475751eb already deleted. [ 738.296095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14a26ad4-6d48-452a-8053-8cb9475751eb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.787703] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5899503-b7f8-4b26-9b77-05fdacbf5c20 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.788062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.795428] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64fa37bf-b60d-4098-9e27-2b7a4436306d with status ACTIVE [ 738.795675] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.795972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.795972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.796267] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.796361] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.796551] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.796659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.796720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.796913] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.796966] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.797170] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.797271] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.797329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.797477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.797550] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.797634] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64fa37bf-b60d-4098-9e27-2b7a4436306d is going to be updated. [ 738.823424] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.823750] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.823850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.824107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.824250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.824446] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64fa37bf-b60d-4098-9e27-2b7a4436306d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.759905] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 in Status: SUCCESS [ 739.760392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.760392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.760490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.760732] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.760850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.760931] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.761125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.761179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.761243] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.775416] env[65413]: INFO networking_nsxv3.common.synchronization [req-3da42958-ace2-437d-b440-b2ea9e1ec48f req-7ee69208-6d37-4944-a82e-ae6fa52f5fde tempest-ServersWithSpecificFlavorTestJSON-163220255 tempest-ServersWithSpecificFlavorTestJSON-163220255-project-member] Enqueued Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_members [ 739.776648] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_members [ 739.777013] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.777836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.777933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.778266] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.778330] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.778682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.778682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.778840] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.778928] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.779039] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.268820] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.282366] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.282366] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.282366] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.282557] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.305488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.305810] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.305934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.305934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.306165] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.306251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.306340] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 is going to be updated. [ 740.335963] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.336102] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.336168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.336384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.338222] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.352309] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 in Status: IN_PROGRESS for 2s [ 740.771218] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.274229] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.274633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.274633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.274741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.274799] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.274889] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 is going to be updated. [ 741.319037] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.319235] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.319235] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.319426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.319606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.340900] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 in Status: IN_PROGRESS for 2s [ 742.372719] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 in Status: SUCCESS [ 742.375340] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 deletion is rescheduled due to dependency. [ 742.375340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.353324] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 in Status: SUCCESS [ 743.354980] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.357058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.357058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.357058] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.357058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.357058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.357058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.357058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.357058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.357058] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.861541] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5899503-b7f8-4b26-9b77-05fdacbf5c20 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.865041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.865041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.865041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.865041] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.865041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.865041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.865041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.865041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.865041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.865041] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5899503-b7f8-4b26-9b77-05fdacbf5c20 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.865041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.865041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.865041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.865041] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.865041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.865041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.865041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.865041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.865971] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.865971] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.221258] env[65413]: INFO networking_nsxv3.common.synchronization [None req-2f4b6b72-afc5-4aa4-a67d-01df9b98d7cb None None] Enqueued Resource ID: 47f2f6c9-309a-4963-bbcd-4d358204edb8 with Priority: HIGHEST for action port [ 744.221258] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 47f2f6c9-309a-4963-bbcd-4d358204edb8 with Priority: HIGHEST for action port [ 744.221258] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-47f2f6c9-309a-4963-bbcd-4d358204edb8 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.221258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-47f2f6c9-309a-4963-bbcd-4d358204edb8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.221258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-47f2f6c9-309a-4963-bbcd-4d358204edb8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.221952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-47f2f6c9-309a-4963-bbcd-4d358204edb8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.222230] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('47f2f6c9-309a-4963-bbcd-4d358204edb8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.306749] env[65413]: INFO networking_nsxv3.common.synchronization [req-4bf17811-a3c3-49ec-96c5-2022b5dcd6f0 req-39943ccd-72a7-41d7-8fb4-aa63cf39567d tempest-DeleteServersTestJSON-2008533967 tempest-DeleteServersTestJSON-2008533967-project-member] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 744.307328] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 744.309285] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.309285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.309285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.309285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.309285] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.309285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.309285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.309285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.309285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.310025] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.366791] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e5899503-b7f8-4b26-9b77-05fdacbf5c20: rpc.has_security_group_logging(os_id): False [ 744.387856] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.388169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.388169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.388575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.412453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.412453] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.412453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.412453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.412453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.412453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.412453] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.412453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.412453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.412776] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.412776] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.412776] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.412990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.413047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.413232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.413351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.413389] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 is going to be updated. [ 744.487837] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.488288] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.488411] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.488706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.488903] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.506594] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 in Status: IN_PROGRESS for 2s [ 744.726029] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 47f2f6c9-309a-4963-bbcd-4d358204edb8 [ 744.726767] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.727088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.727176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.727391] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.727555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.727655] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:47f2f6c9-309a-4963-bbcd-4d358204edb8 already deleted. [ 744.727850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-47f2f6c9-309a-4963-bbcd-4d358204edb8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.815029] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.815029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.815029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.815029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.815255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.815255] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.815344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.815405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.815574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.815640] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.815710] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 744.864027] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.864027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.864027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.864027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.864512] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.875455] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 746.530025] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 in Status: SUCCESS [ 746.530025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.895472] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 746.895675] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 deletion is rescheduled due to dependency. [ 746.895819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.981486] env[65413]: INFO networking_nsxv3.common.synchronization [None req-c6a79f81-4568-4f69-a1cc-a833b8a3bc77 None None] Enqueued Resource ID: ceed6b24-3f56-450b-84f3-74b0b14ff85a with Priority: HIGHEST for action port [ 746.982568] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ceed6b24-3f56-450b-84f3-74b0b14ff85a with Priority: HIGHEST for action port [ 746.983126] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-ceed6b24-3f56-450b-84f3-74b0b14ff85a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.983337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ceed6b24-3f56-450b-84f3-74b0b14ff85a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.983410] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ceed6b24-3f56-450b-84f3-74b0b14ff85a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.983717] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ceed6b24-3f56-450b-84f3-74b0b14ff85a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.983808] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ceed6b24-3f56-450b-84f3-74b0b14ff85a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.282589] env[65413]: INFO networking_nsxv3.common.synchronization [req-c95c05aa-f363-4f9e-803f-60b0fac47e2f req-8b8f9a2c-9aad-4f04-960e-1ba31de264cf tempest-ServerRescueTestJSON-745679716 tempest-ServerRescueTestJSON-745679716-project-member] Enqueued Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_members [ 747.283144] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGHEST for action security_group_members [ 747.284050] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42ae76b-69ae-499f-b565-4ede857c249b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.284050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.284050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.284050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.284050] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.287329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.287329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.287329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.287329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.287329] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.486709] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ceed6b24-3f56-450b-84f3-74b0b14ff85a [ 747.486964] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.487173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.487371] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.487564] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.487698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.487846] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ceed6b24-3f56-450b-84f3-74b0b14ff85a already deleted. [ 747.488115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ceed6b24-3f56-450b-84f3-74b0b14ff85a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.789060] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.789407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.789407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.789586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.813228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.813491] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.813612] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.813684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.813948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.814057] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.814159] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c42ae76b-69ae-499f-b565-4ede857c249b is going to be updated. [ 747.849211] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.851822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.851822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.851822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.851822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.861353] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c42ae76b-69ae-499f-b565-4ede857c249b in Status: IN_PROGRESS for 2s [ 748.370021] env[65413]: INFO networking_nsxv3.common.synchronization [req-9f087862-afa0-4e91-bb32-0dd8cb99022c req-149bbf01-4c97-43d0-83c7-a11c57255949 tempest-SecurityGroupRulesTestJSON-1862792470 tempest-SecurityGroupRulesTestJSON-1862792470-project-member] Enqueued Resource ID: ae4e0ce3-fb58-4bb3-abee-ee14e402090f with Priority: HIGHEST for action security_group_rules [ 748.370021] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae4e0ce3-fb58-4bb3-abee-ee14e402090f with Priority: HIGHEST for action security_group_rules [ 748.371079] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae4e0ce3-fb58-4bb3-abee-ee14e402090f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.371415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae4e0ce3-fb58-4bb3-abee-ee14e402090f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.371676] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae4e0ce3-fb58-4bb3-abee-ee14e402090f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.372059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae4e0ce3-fb58-4bb3-abee-ee14e402090f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.372308] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae4e0ce3-fb58-4bb3-abee-ee14e402090f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.896216] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.896216] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.896216] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.896876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.896876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.896876] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae4e0ce3-fb58-4bb3-abee-ee14e402090f already deleted. [ 748.896876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae4e0ce3-fb58-4bb3-abee-ee14e402090f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.378834] env[65413]: INFO networking_nsxv3.common.synchronization [req-a50d5a83-1138-4b25-b11c-0010e0a736db req-f2b96d6b-9614-4cb5-bc14-51a2b8547b1f tempest-ServersTestManualDisk-948107972 tempest-ServersTestManualDisk-948107972-project-member] Enqueued Resource ID: 832015c1-81fd-4bf2-88c3-58e97531a611 with Priority: HIGHEST for action security_group_members [ 749.379297] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832015c1-81fd-4bf2-88c3-58e97531a611 with Priority: HIGHEST for action security_group_members [ 749.379703] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-832015c1-81fd-4bf2-88c3-58e97531a611 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.379886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.380275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.380275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.380473] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.380576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.380655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.380861] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.380973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.381101] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('832015c1-81fd-4bf2-88c3-58e97531a611',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.874565] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c42ae76b-69ae-499f-b565-4ede857c249b in Status: SUCCESS [ 749.874790] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c42ae76b-69ae-499f-b565-4ede857c249b deletion is rescheduled due to dependency. [ 749.874929] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.883783] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.883952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.884039] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.884281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.913043] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.913043] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.913043] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.913043] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.913440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.913440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.913506] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 832015c1-81fd-4bf2-88c3-58e97531a611 is going to be updated. [ 749.949211] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.950518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.950518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.950518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.950518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.962244] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 832015c1-81fd-4bf2-88c3-58e97531a611 in Status: IN_PROGRESS for 2s [ 750.174092] env[65413]: INFO networking_nsxv3.common.synchronization [None req-9e894d6f-18bf-4fae-b61b-a3b8d2bf0838 None None] Enqueued Resource ID: 29a90138-6f1f-40dd-910b-7baa68c2ee95 with Priority: HIGHEST for action port [ 750.176332] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29a90138-6f1f-40dd-910b-7baa68c2ee95 with Priority: HIGHEST for action port [ 750.176332] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-29a90138-6f1f-40dd-910b-7baa68c2ee95 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.176332] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29a90138-6f1f-40dd-910b-7baa68c2ee95" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.176332] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29a90138-6f1f-40dd-910b-7baa68c2ee95" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.176332] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29a90138-6f1f-40dd-910b-7baa68c2ee95" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.176332] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29a90138-6f1f-40dd-910b-7baa68c2ee95',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.277429] env[65413]: INFO networking_nsxv3.common.synchronization [req-e8c3d80e-6691-4d46-af72-8f6a98af4c10 req-9ea6697c-8c08-4338-a038-16117c4b42cd tempest-FloatingIPsAssociationTestJSON-939090825 tempest-FloatingIPsAssociationTestJSON-939090825-project-member] Enqueued Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_members [ 750.278403] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_members [ 750.278836] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-185b0179-79b1-4f7f-a796-e81c3eb7726c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.280934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.280934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.280934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.280934] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.280934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.280934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.280934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.280934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.280934] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.679377] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29a90138-6f1f-40dd-910b-7baa68c2ee95 [ 750.679687] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.679855] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.680026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.680283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.680397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.680500] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29a90138-6f1f-40dd-910b-7baa68c2ee95 already deleted. [ 750.680589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29a90138-6f1f-40dd-910b-7baa68c2ee95" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.783061] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.979032] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-60 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.979032] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.979032] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.980051] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.980051] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.980147] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.980288] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.980526] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.980864] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.981283] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 750.981436] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 750.981578] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 750.981690] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 750.981848] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 750.982385] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 750.982385] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.009125] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.009403] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 751.009490] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.009656] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.010014] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-05cb2314-d993-4672-b456-457f4e535944 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.010200] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-05cb2314-d993-4672-b456-457f4e535944" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.010316] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-05cb2314-d993-4672-b456-457f4e535944" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.010661] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-05cb2314-d993-4672-b456-457f4e535944" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.010798] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05cb2314-d993-4672-b456-457f4e535944',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.287427] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.513564] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.513775] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.514030] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.514582] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.514582] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.514851] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 05cb2314-d993-4672-b456-457f4e535944 not found, creating... [ 751.515145] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.515311] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.515420] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.515631] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.515754] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.516042] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.516199] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.516320] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.516525] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.516648] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.516809] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 05cb2314-d993-4672-b456-457f4e535944 is going to be created. [ 751.540204] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.540425] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.540538] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.544194] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.544378] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.544607] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-05cb2314-d993-4672-b456-457f4e535944" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.790466] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.790629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.794129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.794129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.794129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.794129] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c is going to be updated. [ 751.841546] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.841776] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.841776] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.845168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.845168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.852986] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c in Status: IN_PROGRESS for 2s [ 751.943185] env[65413]: INFO networking_nsxv3.common.synchronization [None req-d2992a8f-07af-4589-8052-d06fb4897411 None None] Enqueued Resource ID: 3e7814fe-3191-489d-b631-2deda857bb39 with Priority: HIGHEST for action port [ 751.943733] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e7814fe-3191-489d-b631-2deda857bb39 with Priority: HIGHEST for action port [ 751.944045] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e7814fe-3191-489d-b631-2deda857bb39 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.944171] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e7814fe-3191-489d-b631-2deda857bb39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.944244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e7814fe-3191-489d-b631-2deda857bb39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.944491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e7814fe-3191-489d-b631-2deda857bb39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.944575] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e7814fe-3191-489d-b631-2deda857bb39',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.977752] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 832015c1-81fd-4bf2-88c3-58e97531a611 in Status: SUCCESS [ 751.977752] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 832015c1-81fd-4bf2-88c3-58e97531a611 deletion is rescheduled due to dependency. [ 751.977752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.207776] env[65413]: INFO networking_nsxv3.common.synchronization [None req-13ecf8c6-56c7-49c1-b27c-3cf996fde49f None None] Enqueued Resource ID: 0d8ca872-b722-4264-aee4-856bb82b612e with Priority: HIGHEST for action port [ 752.208401] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d8ca872-b722-4264-aee4-856bb82b612e with Priority: HIGHEST for action port [ 752.208714] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d8ca872-b722-4264-aee4-856bb82b612e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.208839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d8ca872-b722-4264-aee4-856bb82b612e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.208907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d8ca872-b722-4264-aee4-856bb82b612e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.209394] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d8ca872-b722-4264-aee4-856bb82b612e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.209466] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d8ca872-b722-4264-aee4-856bb82b612e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.250549] env[65413]: INFO networking_nsxv3.common.synchronization [req-e8c3d80e-6691-4d46-af72-8f6a98af4c10 req-ed1e04df-b32a-46e8-bbd8-e2006312ee75 service nova] Enqueued Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_rules [ 752.250840] env[65413]: INFO networking_nsxv3.common.synchronization [req-e8c3d80e-6691-4d46-af72-8f6a98af4c10 req-ed1e04df-b32a-46e8-bbd8-e2006312ee75 service nova] Enqueued Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_members [ 752.250840] env[65413]: INFO networking_nsxv3.common.synchronization [req-e8c3d80e-6691-4d46-af72-8f6a98af4c10 req-ed1e04df-b32a-46e8-bbd8-e2006312ee75 service nova] Enqueued Resource ID: 05cb2314-d993-4672-b456-457f4e535944 with Priority: HIGHEST for action port [ 752.251373] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_rules [ 752.251506] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_members [ 752.251602] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05cb2314-d993-4672-b456-457f4e535944 with Priority: HIGHEST for action port [ 752.251868] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-185b0179-79b1-4f7f-a796-e81c3eb7726c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.252062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.252227] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.252513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.252628] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.253940] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-185b0179-79b1-4f7f-a796-e81c3eb7726c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.254092] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.254310] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-05cb2314-d993-4672-b456-457f4e535944 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.254443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05cb2314-d993-4672-b456-457f4e535944" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.254526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05cb2314-d993-4672-b456-457f4e535944" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.254848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05cb2314-d993-4672-b456-457f4e535944" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.254931] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05cb2314-d993-4672-b456-457f4e535944',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.447286] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3e7814fe-3191-489d-b631-2deda857bb39 [ 752.447600] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.448284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.448284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.448284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.448284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.448555] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3e7814fe-3191-489d-b631-2deda857bb39 already deleted. [ 752.448555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e7814fe-3191-489d-b631-2deda857bb39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.712237] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0d8ca872-b722-4264-aee4-856bb82b612e [ 752.712378] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.712527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.712622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.712838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.712924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.713027] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0d8ca872-b722-4264-aee4-856bb82b612e already deleted. [ 752.713931] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d8ca872-b722-4264-aee4-856bb82b612e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.755032] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-185b0179-79b1-4f7f-a796-e81c3eb7726c taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.755032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.756420] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 05cb2314-d993-4672-b456-457f4e535944 with status ACTIVE [ 752.756618] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.756745] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.756814] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.757239] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.759121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.759328] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.759440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.759511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.759901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.759901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.760072] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.760072] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.760170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.760259] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.760334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.762733] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 05cb2314-d993-4672-b456-457f4e535944 is going to be updated. [ 752.786209] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.786491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.786491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.786644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.786779] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.786936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05cb2314-d993-4672-b456-457f4e535944" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.805948] env[65413]: INFO networking_nsxv3.common.synchronization [req-5b0b0dff-21bd-4ae8-ab9f-c78e97ed0222 req-2751f0fa-e2c7-45f8-a36d-92239d076d02 tempest-ServersTestFqdnHostnames-958389924 tempest-ServersTestFqdnHostnames-958389924-project-member] Enqueued Resource ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 with Priority: HIGHEST for action security_group_members [ 752.807999] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 with Priority: HIGHEST for action security_group_members [ 752.808451] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0022fbcd-322d-4db7-a1a1-6693d137e213 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.808612] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.808707] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.809027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.809214] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.809322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.809387] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.809558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.809643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.809740] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0022fbcd-322d-4db7-a1a1-6693d137e213',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.314706] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.314706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.314706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.314706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.314706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.314706] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.314706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.314706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.314706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.314706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.314706] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 already deleted. [ 753.314706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.340516] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-596 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.340838] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-596" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.340979] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-596" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.341588] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-596" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.341951] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.342201] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.342420] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.342853] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.342979] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.343297] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.343514] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 753.343781] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 753.343893] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 753.344095] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 753.344296] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 753.344458] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 753.365092] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 753.365263] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 753.365424] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 753.365667] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-596" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.365982] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-869d09a5-4d05-4e13-b1fc-3ba1be7c7859 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.366182] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-869d09a5-4d05-4e13-b1fc-3ba1be7c7859" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.366300] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-869d09a5-4d05-4e13-b1fc-3ba1be7c7859" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.366639] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-869d09a5-4d05-4e13-b1fc-3ba1be7c7859" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.366820] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('869d09a5-4d05-4e13-b1fc-3ba1be7c7859',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.864865] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c in Status: SUCCESS [ 753.865069] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.865445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.865445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.865638] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.865781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.865781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.865940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.866033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.866130] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.869761] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.869761] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.869761] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.870045] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.870262] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.870421] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 869d09a5-4d05-4e13-b1fc-3ba1be7c7859 not found, creating... [ 753.870684] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.870836] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.870945] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.871187] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.871348] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.871727] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.871988] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.872243] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.872579] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.872812] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.873060] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 869d09a5-4d05-4e13-b1fc-3ba1be7c7859 is going to be created. [ 753.897535] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.897535] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.898200] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.898200] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.898512] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.898584] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-869d09a5-4d05-4e13-b1fc-3ba1be7c7859" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.368392] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.479337] env[65413]: INFO networking_nsxv3.common.synchronization [None req-671e5ac7-dc44-4ef0-8441-85207aadba56 None None] Enqueued Resource ID: 063a490a-7bc7-4d89-a91f-231f73d3791a with Priority: HIGHEST for action port [ 754.479813] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 063a490a-7bc7-4d89-a91f-231f73d3791a with Priority: HIGHEST for action port [ 754.481031] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-063a490a-7bc7-4d89-a91f-231f73d3791a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.481031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-063a490a-7bc7-4d89-a91f-231f73d3791a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.481031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-063a490a-7bc7-4d89-a91f-231f73d3791a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.481031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-063a490a-7bc7-4d89-a91f-231f73d3791a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.481031] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('063a490a-7bc7-4d89-a91f-231f73d3791a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.618267] env[65413]: INFO networking_nsxv3.common.synchronization [req-5b0b0dff-21bd-4ae8-ab9f-c78e97ed0222 req-d48362fa-bf14-4008-8ef8-d51dae292721 service nova] Enqueued Resource ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 with Priority: HIGHEST for action security_group_rules [ 754.618267] env[65413]: INFO networking_nsxv3.common.synchronization [req-5b0b0dff-21bd-4ae8-ab9f-c78e97ed0222 req-d48362fa-bf14-4008-8ef8-d51dae292721 service nova] Enqueued Resource ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 with Priority: HIGHEST for action security_group_members [ 754.618267] env[65413]: INFO networking_nsxv3.common.synchronization [req-5b0b0dff-21bd-4ae8-ab9f-c78e97ed0222 req-d48362fa-bf14-4008-8ef8-d51dae292721 service nova] Enqueued Resource ID: 869d09a5-4d05-4e13-b1fc-3ba1be7c7859 with Priority: HIGHEST for action port [ 754.618267] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 with Priority: HIGHEST for action security_group_rules [ 754.618267] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 with Priority: HIGHEST for action security_group_members [ 754.618267] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 869d09a5-4d05-4e13-b1fc-3ba1be7c7859 with Priority: HIGHEST for action port [ 754.618494] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0022fbcd-322d-4db7-a1a1-6693d137e213 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.618589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.619055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.619055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.619055] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0022fbcd-322d-4db7-a1a1-6693d137e213',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.620819] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0022fbcd-322d-4db7-a1a1-6693d137e213 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.620819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.620819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.620819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.621071] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.621071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.621153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.621314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.621373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.621628] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0022fbcd-322d-4db7-a1a1-6693d137e213',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.622568] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-869d09a5-4d05-4e13-b1fc-3ba1be7c7859 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.622568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-869d09a5-4d05-4e13-b1fc-3ba1be7c7859" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.622568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-869d09a5-4d05-4e13-b1fc-3ba1be7c7859" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.622568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-869d09a5-4d05-4e13-b1fc-3ba1be7c7859" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.622847] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('869d09a5-4d05-4e13-b1fc-3ba1be7c7859',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.871130] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.982749] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 063a490a-7bc7-4d89-a91f-231f73d3791a [ 754.983084] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.983324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.983401] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.983592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.983711] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.983823] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:063a490a-7bc7-4d89-a91f-231f73d3791a already deleted. [ 754.983924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-063a490a-7bc7-4d89-a91f-231f73d3791a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.124775] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0022fbcd-322d-4db7-a1a1-6693d137e213 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.124940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.130512] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0022fbcd-322d-4db7-a1a1-6693d137e213',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.131508] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 869d09a5-4d05-4e13-b1fc-3ba1be7c7859 with status ACTIVE [ 755.131890] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.131890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.132042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.132182] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.132261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.132471] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.132561] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.132599] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.132754] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.132829] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.133020] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.133110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.133170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.133306] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.133390] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.133471] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 869d09a5-4d05-4e13-b1fc-3ba1be7c7859 is going to be updated. [ 755.161501] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.161501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.161501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.161501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.161501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.161501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-869d09a5-4d05-4e13-b1fc-3ba1be7c7859" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.376807] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.377689] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.377689] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.377689] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.377689] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.377689] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c is going to be updated. [ 755.426761] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.426761] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.426761] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.427310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.427643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.440122] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c in Status: IN_PROGRESS for 2s [ 755.639311] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0022fbcd-322d-4db7-a1a1-6693d137e213',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.146207] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.146207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.146207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.146207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.146207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.146207] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 is going to be created. [ 756.177872] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.178055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.178839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.181107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.181107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.193110] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 in Status: UNINITIALIZED for 2s [ 756.660324] env[65413]: INFO networking_nsxv3.common.synchronization [req-0ea62014-014f-4ecf-ad82-bf4e8d55c10f req-d13a5be8-ef6d-4544-872c-3ed2c27df689 tempest-SecurityGroupRulesTestJSON-1862792470 tempest-SecurityGroupRulesTestJSON-1862792470-project-member] Enqueued Resource ID: d4df1987-c717-405e-b380-53d0f2b6284b with Priority: HIGHEST for action security_group_rules [ 756.660324] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4df1987-c717-405e-b380-53d0f2b6284b with Priority: HIGHEST for action security_group_rules [ 756.660324] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4df1987-c717-405e-b380-53d0f2b6284b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.660324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4df1987-c717-405e-b380-53d0f2b6284b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.660324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4df1987-c717-405e-b380-53d0f2b6284b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.660324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4df1987-c717-405e-b380-53d0f2b6284b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.660324] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4df1987-c717-405e-b380-53d0f2b6284b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.183706] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.183706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.183706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.183919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.183919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.183919] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4df1987-c717-405e-b380-53d0f2b6284b already deleted. [ 757.184013] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4df1987-c717-405e-b380-53d0f2b6284b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.452804] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c in Status: SUCCESS [ 757.452946] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.453198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.453548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.453837] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.454041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.454144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.454430] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.454520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.454671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.455328] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.510209] env[65413]: INFO networking_nsxv3.common.synchronization [req-b57c9803-ffaa-4eb9-9d63-df9ee030e646 req-208de6a3-45cd-4ebe-b3d7-bed5b8488c97 tempest-AttachInterfacesUnderV243Test-1674623919 tempest-AttachInterfacesUnderV243Test-1674623919-project-member] Enqueued Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_members [ 757.510331] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_members [ 757.510609] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.510726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.510785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.511079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.511271] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.511446] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.511446] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.511602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.511690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.511784] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.958626] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-185b0179-79b1-4f7f-a796-e81c3eb7726c taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.958958] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.958958] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.959292] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.959542] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.959679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.959761] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.959945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.960385] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.960504] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.960743] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-185b0179-79b1-4f7f-a796-e81c3eb7726c taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.960863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.960929] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.961108] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.961378] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.961477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.961543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.961688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.961768] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.961845] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.961992] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.014525] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.014525] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.014525] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.014719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.015748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.015748] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.015748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.015748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.015748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.015748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.015748] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b already deleted. [ 758.015748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.098676] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.098910] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-842" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.099069] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-842" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.099706] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-842" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.099706] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.099889] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.100008] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.100252] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.100392] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.100619] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.100730] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 758.100831] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 758.100933] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 758.101101] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 758.101233] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 758.101358] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 758.122830] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 758.122988] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 758.123203] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 758.123664] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-842" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.123887] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-01617bc3-9032-4f9a-8e3e-db7fab34f17d taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.124511] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.124511] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.124903] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.125154] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01617bc3-9032-4f9a-8e3e-db7fab34f17d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.203456] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 in Status: SUCCESS [ 758.203456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.203456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.203456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.203736] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.203736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.203736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.203986] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.204101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.204202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.204293] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0022fbcd-322d-4db7-a1a1-6693d137e213',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.464428] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 185b0179-79b1-4f7f-a796-e81c3eb7726c: rpc.has_security_group_logging(os_id): False [ 758.485043] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.486848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.486848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.486848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.486848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.486848] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.486848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.487244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.487463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.487549] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.487789] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.487893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.487953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.488354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.488431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.488630] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.488733] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.488784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.488925] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.489878] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.489878] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c is going to be updated. [ 758.563217] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.563381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.563421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.563978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.564215] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.577460] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c in Status: IN_PROGRESS for 2s [ 758.627558] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.627765] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.627894] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.628234] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.628909] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.629114] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 01617bc3-9032-4f9a-8e3e-db7fab34f17d not found, creating... [ 758.629876] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.629876] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.630121] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.630488] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.630651] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.631159] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.631357] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.631471] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.631750] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.631900] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.632781] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 01617bc3-9032-4f9a-8e3e-db7fab34f17d is going to be created. [ 758.661916] env[65413]: INFO networking_nsxv3.common.synchronization [None req-c3d3f414-9bc6-44e9-b37c-9456f12ca90e None None] Enqueued Resource ID: 2fc500c7-9a27-4cdb-8798-6d6922e11f7b with Priority: HIGHEST for action port [ 758.663735] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.663965] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.664183] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.664462] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.664682] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.665155] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.666328] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fc500c7-9a27-4cdb-8798-6d6922e11f7b with Priority: HIGHEST for action port [ 758.667213] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fc500c7-9a27-4cdb-8798-6d6922e11f7b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.667407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fc500c7-9a27-4cdb-8798-6d6922e11f7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.667480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fc500c7-9a27-4cdb-8798-6d6922e11f7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.667893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fc500c7-9a27-4cdb-8798-6d6922e11f7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.668014] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fc500c7-9a27-4cdb-8798-6d6922e11f7b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.706891] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0022fbcd-322d-4db7-a1a1-6693d137e213',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.170543] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2fc500c7-9a27-4cdb-8798-6d6922e11f7b [ 759.170898] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.170966] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.171067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.171348] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.171455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.171562] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2fc500c7-9a27-4cdb-8798-6d6922e11f7b already deleted. [ 759.171661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fc500c7-9a27-4cdb-8798-6d6922e11f7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.208976] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0022fbcd-322d-4db7-a1a1-6693d137e213: rpc.has_security_group_logging(os_id): False [ 759.230182] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.230389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.230521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.231270] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.231270] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.231389] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.231569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.231674] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.231919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.232068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.232207] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 is going to be created. [ 759.304491] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.304491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.304491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.304491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.304491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.307511] env[65413]: INFO networking_nsxv3.common.synchronization [req-859fbf7c-d3fc-4123-9a28-54bdb03d65cb req-c09b02ae-f6b3-4a75-bb7d-05a706c053f2 tempest-SecurityGroupRulesTestJSON-1862792470 tempest-SecurityGroupRulesTestJSON-1862792470-project-member] Enqueued Resource ID: d4df1987-c717-405e-b380-53d0f2b6284b with Priority: HIGHEST for action security_group_rules [ 759.308207] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4df1987-c717-405e-b380-53d0f2b6284b with Priority: HIGHEST for action security_group_rules [ 759.308494] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4df1987-c717-405e-b380-53d0f2b6284b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.308653] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4df1987-c717-405e-b380-53d0f2b6284b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.308735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4df1987-c717-405e-b380-53d0f2b6284b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.308896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4df1987-c717-405e-b380-53d0f2b6284b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.308994] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4df1987-c717-405e-b380-53d0f2b6284b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.318453] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 in Status: IN_PROGRESS for 2s [ 759.409272] env[65413]: INFO networking_nsxv3.common.synchronization [req-b57c9803-ffaa-4eb9-9d63-df9ee030e646 req-97638eb7-f6b6-4ed4-bccc-6f342696aa64 service nova] Enqueued Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_rules [ 759.409272] env[65413]: INFO networking_nsxv3.common.synchronization [req-b57c9803-ffaa-4eb9-9d63-df9ee030e646 req-97638eb7-f6b6-4ed4-bccc-6f342696aa64 service nova] Enqueued Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_members [ 759.409272] env[65413]: INFO networking_nsxv3.common.synchronization [req-b57c9803-ffaa-4eb9-9d63-df9ee030e646 req-97638eb7-f6b6-4ed4-bccc-6f342696aa64 service nova] Enqueued Resource ID: 01617bc3-9032-4f9a-8e3e-db7fab34f17d with Priority: HIGHEST for action port [ 759.410530] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_rules [ 759.412167] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_members [ 759.412167] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01617bc3-9032-4f9a-8e3e-db7fab34f17d with Priority: HIGHEST for action port [ 759.412167] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.412167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.412167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.412167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.412167] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.413384] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.413546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.413634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.413856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.414059] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.414188] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.414342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.414440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.414528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.414702] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.415627] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-01617bc3-9032-4f9a-8e3e-db7fab34f17d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.415859] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.415941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.416155] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.416664] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01617bc3-9032-4f9a-8e3e-db7fab34f17d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.820117] env[65413]: INFO networking_nsxv3.common.synchronization [req-3c4ce529-3fcb-4b34-bf34-628bf08cf80e req-e14b5e34-ca53-419e-84f5-a8cffcdde73c tempest-InstanceActionsTestJSON-50475776 tempest-InstanceActionsTestJSON-50475776-project-member] Enqueued Resource ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 with Priority: HIGHEST for action security_group_members [ 759.820708] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 with Priority: HIGHEST for action security_group_members [ 759.821063] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-2204e101-51b2-465b-9a7b-c28fa89afdc1 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.821216] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.821282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.821537] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.821700] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.821815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.821879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.822055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.822440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.822440] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2204e101-51b2-465b-9a7b-c28fa89afdc1',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.842073] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.842355] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.842355] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.842902] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.842902] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.842902] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4df1987-c717-405e-b380-53d0f2b6284b already deleted. [ 759.842902] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4df1987-c717-405e-b380-53d0f2b6284b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.920279] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.920279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.920588] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.924189] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01617bc3-9032-4f9a-8e3e-db7fab34f17d with status ACTIVE [ 759.924189] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.924189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.924189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.924189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.924189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.924189] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.924189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.924189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.924189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.924189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.924189] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.924189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.924189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.924189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.924189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.924189] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01617bc3-9032-4f9a-8e3e-db7fab34f17d is going to be updated. [ 759.948315] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.948497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.948919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.948919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.949083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.949216] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.249472] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-654 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.249801] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-654" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.249954] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-654" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.250337] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-654" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.250684] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.250910] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.251073] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.251385] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.251541] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.251796] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.251916] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 760.252035] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 760.252153] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 760.252252] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 760.252354] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 760.252504] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 760.275755] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 760.275869] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 760.276249] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 760.276443] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-654" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.277016] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-0facf092-f085-4238-8b19-9cb970fcab90 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.277338] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-0facf092-f085-4238-8b19-9cb970fcab90" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.278086] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-0facf092-f085-4238-8b19-9cb970fcab90" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.278086] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-0facf092-f085-4238-8b19-9cb970fcab90" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.278086] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0facf092-f085-4238-8b19-9cb970fcab90',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.326116] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.326116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.326116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.326458] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.326534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.326891] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.327089] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.327089] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.328018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.328018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.328018] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 already deleted. [ 760.328018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.426565] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.596716] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c in Status: SUCCESS [ 760.597388] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.781485] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.781485] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.781712] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.782685] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.782923] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.783556] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 0facf092-f085-4238-8b19-9cb970fcab90 not found, creating... [ 760.784889] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.785099] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.785647] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.786366] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.786595] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.787333] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.788259] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.788427] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.788752] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.788889] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.789047] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 0facf092-f085-4238-8b19-9cb970fcab90 is going to be created. [ 760.815801] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.816057] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.816141] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.816429] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.816654] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.816900] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-0facf092-f085-4238-8b19-9cb970fcab90" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.929963] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.930616] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.930716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.930975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.931109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.931212] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b is going to be created. [ 760.957316] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.957584] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.957700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.958015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.958202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.970845] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: UNINITIALIZED for 2s [ 761.265235] env[65413]: INFO networking_nsxv3.common.synchronization [None req-e3c942bd-5c19-45f8-b289-aa0586a108a5 None None] Enqueued Resource ID: 4a561722-e853-422b-b413-0e108d6b2b4c with Priority: HIGHEST for action port [ 761.268566] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a561722-e853-422b-b413-0e108d6b2b4c with Priority: HIGHEST for action port [ 761.268566] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a561722-e853-422b-b413-0e108d6b2b4c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.268566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a561722-e853-422b-b413-0e108d6b2b4c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.268566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a561722-e853-422b-b413-0e108d6b2b4c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.268566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a561722-e853-422b-b413-0e108d6b2b4c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.268566] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a561722-e853-422b-b413-0e108d6b2b4c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.333714] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 in Status: SUCCESS [ 761.335034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.550386] env[65413]: INFO networking_nsxv3.common.synchronization [req-3c4ce529-3fcb-4b34-bf34-628bf08cf80e req-0b40e842-a8c3-4f64-9587-94f82084a3a4 service nova] Enqueued Resource ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 with Priority: HIGHEST for action security_group_rules [ 761.550616] env[65413]: INFO networking_nsxv3.common.synchronization [req-3c4ce529-3fcb-4b34-bf34-628bf08cf80e req-0b40e842-a8c3-4f64-9587-94f82084a3a4 service nova] Enqueued Resource ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 with Priority: HIGHEST for action security_group_members [ 761.550727] env[65413]: INFO networking_nsxv3.common.synchronization [req-3c4ce529-3fcb-4b34-bf34-628bf08cf80e req-0b40e842-a8c3-4f64-9587-94f82084a3a4 service nova] Enqueued Resource ID: 0facf092-f085-4238-8b19-9cb970fcab90 with Priority: HIGHEST for action port [ 761.551278] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 with Priority: HIGHEST for action security_group_rules [ 761.551421] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 with Priority: HIGHEST for action security_group_members [ 761.551517] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0facf092-f085-4238-8b19-9cb970fcab90 with Priority: HIGHEST for action port [ 761.551805] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2204e101-51b2-465b-9a7b-c28fa89afdc1 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.551967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.553396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.553945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.553945] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2204e101-51b2-465b-9a7b-c28fa89afdc1',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.555518] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-2204e101-51b2-465b-9a7b-c28fa89afdc1 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.555518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.555518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.555518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.555518] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.555518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.555518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.555518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.555518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.555970] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2204e101-51b2-465b-9a7b-c28fa89afdc1',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.556392] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0facf092-f085-4238-8b19-9cb970fcab90 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.556491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0facf092-f085-4238-8b19-9cb970fcab90" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.556565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0facf092-f085-4238-8b19-9cb970fcab90" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.557070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0facf092-f085-4238-8b19-9cb970fcab90" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.557070] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0facf092-f085-4238-8b19-9cb970fcab90',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.769093] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4a561722-e853-422b-b413-0e108d6b2b4c [ 761.769690] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.769767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.769819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.770256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.770885] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.770885] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4a561722-e853-422b-b413-0e108d6b2b4c already deleted. [ 761.770885] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a561722-e853-422b-b413-0e108d6b2b4c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.058885] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2204e101-51b2-465b-9a7b-c28fa89afdc1',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.060106] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-2204e101-51b2-465b-9a7b-c28fa89afdc1 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.060106] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.060106] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0facf092-f085-4238-8b19-9cb970fcab90 with status ACTIVE [ 762.060341] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.060415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.060463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.060638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.060725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.060882] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.060968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.061056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.061223] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.061312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.061470] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.061564] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.061628] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.061758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.061832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.061914] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0facf092-f085-4238-8b19-9cb970fcab90 is going to be updated. [ 762.090168] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.090168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.090168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.090168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.090168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.090168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0facf092-f085-4238-8b19-9cb970fcab90" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.567824] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2204e101-51b2-465b-9a7b-c28fa89afdc1',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.725218] env[65413]: INFO networking_nsxv3.common.synchronization [None req-466a1aec-dbe0-4883-a913-663bde2d8455 tempest-ServerActionsTestOtherB-69504015 tempest-ServerActionsTestOtherB-69504015-project-member] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_rules [ 762.727103] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_rules [ 762.727103] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.727103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.727444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.727605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.728041] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.866631] env[65413]: INFO networking_nsxv3.common.synchronization [None req-d9a4c8cd-c453-4686-9c31-1eb0a3af7451 tempest-ServerActionsTestOtherB-69504015 tempest-ServerActionsTestOtherB-69504015-project-member] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_rules [ 762.867021] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_rules [ 762.867386] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.867780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.982942] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: SUCCESS [ 762.983174] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.983345] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.983574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.984737] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.984737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.984737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.984737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.984737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.984737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.984737] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.070546] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.071070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.071070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.071406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.071406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.071640] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 is going to be created. [ 763.097076] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.097352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.097352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.097529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.097664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.114165] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 in Status: UNINITIALIZED for 2s [ 763.249837] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.250009] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.250091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.250330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.250424] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.250522] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded already deleted. [ 763.250618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.251959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.252190] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.252289] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.486483] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.523873] env[65413]: INFO networking_nsxv3.common.synchronization [req-25175260-0669-4cfb-a3c0-b567ec049b9f req-2082d748-f142-4119-b893-6534d0f30ea5 tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGHEST for action security_group_members [ 763.524356] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGHEST for action security_group_members [ 763.524666] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.525504] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.525504] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.526070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.526295] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.526449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.526534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.527080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.527080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.530145] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcfdc2e3-2cc7-44cc-8355-9f87d267f435',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.774590] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.774959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.774959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.775527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.775527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.775527] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded already deleted. [ 763.775527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.836451] env[65413]: INFO networking_nsxv3.common.synchronization [req-c470b0e6-3d82-4135-ae8e-945f9cb127a4 req-a3579d79-44bd-4f28-9a24-f90ba2a60282 tempest-SecurityGroupRulesTestJSON-1862792470 tempest-SecurityGroupRulesTestJSON-1862792470-project-member] Enqueued Resource ID: d4df1987-c717-405e-b380-53d0f2b6284b with Priority: HIGHEST for action security_group_rules [ 763.836451] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4df1987-c717-405e-b380-53d0f2b6284b with Priority: HIGHEST for action security_group_rules [ 763.837528] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d4df1987-c717-405e-b380-53d0f2b6284b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.837528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d4df1987-c717-405e-b380-53d0f2b6284b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.837528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d4df1987-c717-405e-b380-53d0f2b6284b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.837528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d4df1987-c717-405e-b380-53d0f2b6284b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.837528] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d4df1987-c717-405e-b380-53d0f2b6284b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.872039] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.872039] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.872039] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.872913] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.873273] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.873449] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.873565] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.873869] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.874079] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.874337] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.874514] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 763.874632] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 763.874736] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 763.874872] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 763.874976] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 763.875130] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.894556] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.894711] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 763.894838] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.895029] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.895613] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-08d3fe0e-6873-4a48-b3a7-c5e5fc03263d taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.895613] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-08d3fe0e-6873-4a48-b3a7-c5e5fc03263d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.895613] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-08d3fe0e-6873-4a48-b3a7-c5e5fc03263d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.895971] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-08d3fe0e-6873-4a48-b3a7-c5e5fc03263d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.896079] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08d3fe0e-6873-4a48-b3a7-c5e5fc03263d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.992445] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c56a7ec-65f7-4b28-8303-747aa0500c3b: rpc.has_security_group_logging(os_id): False [ 764.013058] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.013187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.013341] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.013458] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.013548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.013805] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.013903] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.013966] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.014213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.014298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.014439] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b is going to be created. [ 764.034094] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.034229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.034300] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.034572] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.034668] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.035160] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.035276] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.036836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.036836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.036836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.036836] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 already deleted. [ 764.036836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.083604] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.083782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.083826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.084046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.084232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.099072] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: IN_PROGRESS for 2s [ 764.360424] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.360424] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.360424] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.360424] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.360424] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.360424] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d4df1987-c717-405e-b380-53d0f2b6284b already deleted. [ 764.360424] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d4df1987-c717-405e-b380-53d0f2b6284b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.399538] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.399780] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.399900] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.400285] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.400439] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.400613] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 08d3fe0e-6873-4a48-b3a7-c5e5fc03263d not found, creating... [ 764.400893] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.401086] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.401211] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.401506] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.401624] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.401847] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.402137] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.402137] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.402375] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.402465] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.402596] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 08d3fe0e-6873-4a48-b3a7-c5e5fc03263d is going to be created. [ 764.426196] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.427016] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.427016] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.427016] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.427231] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.427491] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-08d3fe0e-6873-4a48-b3a7-c5e5fc03263d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.125304] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 in Status: SUCCESS [ 765.125672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.125739] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.125905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.126121] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.126273] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.126351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.126572] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.126661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.126746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.126866] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2204e101-51b2-465b-9a7b-c28fa89afdc1',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.159857] env[65413]: INFO networking_nsxv3.common.synchronization [req-25175260-0669-4cfb-a3c0-b567ec049b9f req-cff8dbad-c0f8-4885-afbc-4854f4c8cb6b service nova] Enqueued Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGHEST for action security_group_rules [ 765.160031] env[65413]: INFO networking_nsxv3.common.synchronization [req-25175260-0669-4cfb-a3c0-b567ec049b9f req-cff8dbad-c0f8-4885-afbc-4854f4c8cb6b service nova] Enqueued Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGHEST for action security_group_members [ 765.160205] env[65413]: INFO networking_nsxv3.common.synchronization [req-25175260-0669-4cfb-a3c0-b567ec049b9f req-cff8dbad-c0f8-4885-afbc-4854f4c8cb6b service nova] Enqueued Resource ID: 08d3fe0e-6873-4a48-b3a7-c5e5fc03263d with Priority: HIGHEST for action port [ 765.160733] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGHEST for action security_group_rules [ 765.160863] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGHEST for action security_group_members [ 765.160959] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08d3fe0e-6873-4a48-b3a7-c5e5fc03263d with Priority: HIGHEST for action port [ 765.163342] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.163479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.163547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.163760] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.163842] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcfdc2e3-2cc7-44cc-8355-9f87d267f435',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.166236] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.166236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.166236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.166236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.166236] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.166236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.166236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.166236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.166552] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.166552] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcfdc2e3-2cc7-44cc-8355-9f87d267f435',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.167163] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-08d3fe0e-6873-4a48-b3a7-c5e5fc03263d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.167300] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08d3fe0e-6873-4a48-b3a7-c5e5fc03263d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.167334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08d3fe0e-6873-4a48-b3a7-c5e5fc03263d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.169016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08d3fe0e-6873-4a48-b3a7-c5e5fc03263d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.169016] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08d3fe0e-6873-4a48-b3a7-c5e5fc03263d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.631343] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-2204e101-51b2-465b-9a7b-c28fa89afdc1 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.631343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.631343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.631343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.631343] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.631343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.632164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.632164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.632164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.632308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.632487] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-2204e101-51b2-465b-9a7b-c28fa89afdc1 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.632592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.632655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.632807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.632953] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.633058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.633119] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.633263] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.633340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.633419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.633508] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2204e101-51b2-465b-9a7b-c28fa89afdc1',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.669249] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.669507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.669801] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fcfdc2e3-2cc7-44cc-8355-9f87d267f435',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.670683] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08d3fe0e-6873-4a48-b3a7-c5e5fc03263d with status ACTIVE [ 765.670899] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.670991] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.671075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.671323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.671482] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.671954] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.671954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.671954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.671954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.672902] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.673088] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.673192] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.673245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.673400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.673474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.673558] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08d3fe0e-6873-4a48-b3a7-c5e5fc03263d is going to be updated. [ 765.700348] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.700520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.702975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.702975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.702975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.702975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08d3fe0e-6873-4a48-b3a7-c5e5fc03263d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.112426] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: SUCCESS [ 766.112763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.136905] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2204e101-51b2-465b-9a7b-c28fa89afdc1: rpc.has_security_group_logging(os_id): False [ 766.165493] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.165769] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.165769] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.166479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.166479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.166479] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.166479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.166479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.167151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.167151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.167151] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.167151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.167151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.167421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.167421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.167556] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.167634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.168210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.168441] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.168513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.168568] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 is going to be created. [ 766.176371] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fcfdc2e3-2cc7-44cc-8355-9f87d267f435',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.241624] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.244205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.244205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.244560] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.244914] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.261702] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 in Status: IN_PROGRESS for 2s [ 766.681388] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.681571] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.681614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.681839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.681932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.682044] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 is going to be created. [ 766.711865] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.712185] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.712185] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.712414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.712572] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.723967] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 in Status: UNINITIALIZED for 2s [ 766.791124] env[65413]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 766.791424] env[65413]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] NSXv3 Agent Agent loop - iteration:1 started [ 768.121257] env[65413]: INFO networking_nsxv3.common.synchronization [req-ba860634-a82c-43b6-8728-2556cd23722e req-b97e6470-7fb3-469b-9760-b7b50c61f46b tempest-VolumesAssistedSnapshotsTest-1837750333 tempest-VolumesAssistedSnapshotsTest-1837750333-project-member] Enqueued Resource ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 with Priority: HIGHEST for action security_group_members [ 768.121764] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 with Priority: HIGHEST for action security_group_members [ 768.122339] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7541a263-2861-4b4d-ab51-2db5044fecf7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.122693] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.122693] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.123328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.123328] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.123328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.123328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.123543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.123575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.123746] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7541a263-2861-4b4d-ab51-2db5044fecf7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.275175] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 in Status: SUCCESS [ 768.275384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.387493] env[65413]: INFO networking_nsxv3.common.synchronization [req-4671582e-3860-4de9-bb40-bf33ab3d896f req-ec7b736f-eb4a-49d3-8a7a-1b4903406c53 tempest-ServersWithSpecificFlavorTestJSON-163220255 tempest-ServersWithSpecificFlavorTestJSON-163220255-project-member] Enqueued Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_members [ 768.388267] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_members [ 768.389079] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.389079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.389079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.389251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.389394] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.389497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.389650] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.389806] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.389806] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.389938] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.625761] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.625931] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.626008] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.627352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.652485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.652773] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.652896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.652961] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.653214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.653300] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.653387] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 is going to be updated. [ 768.684527] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.684527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.684527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.684895] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.684895] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.695618] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 in Status: IN_PROGRESS for 2s [ 768.736885] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 in Status: SUCCESS [ 768.737026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.737094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.737320] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.737549] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.737853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.737853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.737955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.737955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.738102] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.738209] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fcfdc2e3-2cc7-44cc-8355-9f87d267f435',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.840848] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-863 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.841166] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-863" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.841249] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-863" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.842242] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-863" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.842242] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.842242] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.842242] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.843286] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.843523] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.843843] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.844047] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.844226] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.844400] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.844582] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.844765] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.844967] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.870075] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.870410] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 768.870617] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.870872] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-863" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.871919] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-de8f6bf3-3454-434f-9db4-4e5b8edf2cac taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.871919] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-de8f6bf3-3454-434f-9db4-4e5b8edf2cac" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.871919] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-de8f6bf3-3454-434f-9db4-4e5b8edf2cac" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.872356] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-de8f6bf3-3454-434f-9db4-4e5b8edf2cac" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.872722] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de8f6bf3-3454-434f-9db4-4e5b8edf2cac',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.894690] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.894690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.894690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.894690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.894690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.894951] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.895082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.895181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.895417] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.895540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.895668] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 is going to be updated. [ 768.930035] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.930035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.930035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.930035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.930035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.941658] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 in Status: IN_PROGRESS for 2s [ 769.244222] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fcfdc2e3-2cc7-44cc-8355-9f87d267f435',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.377044] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.377044] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.377044] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.377474] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.377474] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.377839] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port de8f6bf3-3454-434f-9db4-4e5b8edf2cac not found, creating... [ 769.378988] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.378988] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.378988] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.378988] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.378988] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.378988] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.378988] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.379515] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.379515] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.379515] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.379654] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: de8f6bf3-3454-434f-9db4-4e5b8edf2cac is going to be created. [ 769.404150] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.404478] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.404623] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.405085] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.405430] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.405737] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-de8f6bf3-3454-434f-9db4-4e5b8edf2cac" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.748316] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fcfdc2e3-2cc7-44cc-8355-9f87d267f435: rpc.has_security_group_logging(os_id): False [ 769.772109] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.772301] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.772376] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.772670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.772739] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.772976] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.773657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.775217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.775217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.775217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.775217] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 is going to be created. [ 769.854374] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.854659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.854843] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.855187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.855546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.871057] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 in Status: IN_PROGRESS for 2s [ 770.246286] env[65413]: INFO networking_nsxv3.common.synchronization [req-4671582e-3860-4de9-bb40-bf33ab3d896f req-bb8f4785-db41-4d2f-8b8f-a592c6e25600 service nova] Enqueued Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_rules [ 770.250913] env[65413]: INFO networking_nsxv3.common.synchronization [req-4671582e-3860-4de9-bb40-bf33ab3d896f req-bb8f4785-db41-4d2f-8b8f-a592c6e25600 service nova] Enqueued Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_members [ 770.251414] env[65413]: INFO networking_nsxv3.common.synchronization [req-4671582e-3860-4de9-bb40-bf33ab3d896f req-bb8f4785-db41-4d2f-8b8f-a592c6e25600 service nova] Enqueued Resource ID: de8f6bf3-3454-434f-9db4-4e5b8edf2cac with Priority: HIGHEST for action port [ 770.252527] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_rules [ 770.252867] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_members [ 770.253563] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de8f6bf3-3454-434f-9db4-4e5b8edf2cac with Priority: HIGHEST for action port [ 770.254111] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.254447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.254662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.255040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.255267] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.257041] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.257341] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.257743] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-de8f6bf3-3454-434f-9db4-4e5b8edf2cac taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.258480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de8f6bf3-3454-434f-9db4-4e5b8edf2cac" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.258718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de8f6bf3-3454-434f-9db4-4e5b8edf2cac" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.259097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de8f6bf3-3454-434f-9db4-4e5b8edf2cac" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.259313] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de8f6bf3-3454-434f-9db4-4e5b8edf2cac',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.708946] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 in Status: SUCCESS [ 770.709308] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 deletion is rescheduled due to dependency. [ 770.709644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.761276] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.761467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.761655] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de8f6bf3-3454-434f-9db4-4e5b8edf2cac with status ACTIVE [ 770.761833] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.761941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.762016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.762254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.762342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.762704] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.762867] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.762936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.763126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.763217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.763412] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.763554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.763554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.763707] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.763787] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.763870] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de8f6bf3-3454-434f-9db4-4e5b8edf2cac is going to be updated. [ 770.802185] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.802402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.802402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.802618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.802655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.802851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de8f6bf3-3454-434f-9db4-4e5b8edf2cac" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.963121] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 in Status: SUCCESS [ 770.963516] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 deletion is rescheduled due to dependency. [ 770.963643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.965022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.965022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.965022] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.965022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.965022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.965022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.965022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.965460] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.120347] env[65413]: INFO networking_nsxv3.common.synchronization [req-559e5174-2d4a-4fd3-a4e3-2d0beac767b6 req-ddede4bf-8e96-400b-aef8-47faf0c8e4d8 tempest-ImagesOneServerNegativeTestJSON-1663656844 tempest-ImagesOneServerNegativeTestJSON-1663656844-project-member] Enqueued Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 771.120944] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 771.121313] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.121438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.121500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.121707] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.121862] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.122109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.122109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.122279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.125051] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.125051] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.467663] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.532738] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.532977] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-327" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.533117] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-327" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.533392] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-327" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.533724] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.533870] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.533984] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.534239] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.534418] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.534714] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.534888] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.535072] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.535522] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.535522] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.535681] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.535851] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.559772] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.560097] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 771.560308] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.560521] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-327" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.560914] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-73147567-8f06-4d30-aa7a-136f3fdfc02b taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.561190] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-73147567-8f06-4d30-aa7a-136f3fdfc02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.561328] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-73147567-8f06-4d30-aa7a-136f3fdfc02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.561687] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-73147567-8f06-4d30-aa7a-136f3fdfc02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.561806] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73147567-8f06-4d30-aa7a-136f3fdfc02b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.626372] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.626372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.626372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.626372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.658107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.658107] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.658107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.658107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.658107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.658107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.658107] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 is going to be updated. [ 771.692662] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.696133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.696133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.696133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.696133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.706453] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: IN_PROGRESS for 2s [ 771.894612] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 in Status: SUCCESS [ 771.894612] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.970464] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.065464] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.065726] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.065853] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.066167] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.066308] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.066471] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 73147567-8f06-4d30-aa7a-136f3fdfc02b not found, creating... [ 772.067214] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.067214] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.067214] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.067402] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.067402] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.067631] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.067776] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.067881] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.069347] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.069578] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.069765] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 73147567-8f06-4d30-aa7a-136f3fdfc02b is going to be created. [ 772.095505] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.095771] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.095897] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.096188] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.096405] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.096739] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-73147567-8f06-4d30-aa7a-136f3fdfc02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.473684] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.474019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.474019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.474516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.474516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.474516] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 is going to be updated. [ 772.503924] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.503924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.503924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.503924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.503924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.513445] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 in Status: IN_PROGRESS for 2s [ 772.681334] env[65413]: INFO networking_nsxv3.common.synchronization [req-21daaebb-a5e4-4293-84b5-b375049e4526 req-bf01dd6f-486a-4aa7-99b5-29b50c0f916a tempest-ImagesTestJSON-1309992501 tempest-ImagesTestJSON-1309992501-project-member] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 772.681892] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 772.682207] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.682350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.682458] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.682712] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.682886] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.683502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.683502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.683502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.683502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.683502] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.818420] env[65413]: INFO networking_nsxv3.common.synchronization [req-559e5174-2d4a-4fd3-a4e3-2d0beac767b6 req-ea337d61-07b4-4a91-a10e-20d2de60f485 service nova] Enqueued Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_rules [ 772.818420] env[65413]: INFO networking_nsxv3.common.synchronization [req-559e5174-2d4a-4fd3-a4e3-2d0beac767b6 req-ea337d61-07b4-4a91-a10e-20d2de60f485 service nova] Enqueued Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 772.818420] env[65413]: INFO networking_nsxv3.common.synchronization [req-559e5174-2d4a-4fd3-a4e3-2d0beac767b6 req-ea337d61-07b4-4a91-a10e-20d2de60f485 service nova] Enqueued Resource ID: 73147567-8f06-4d30-aa7a-136f3fdfc02b with Priority: HIGHEST for action port [ 772.818420] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_rules [ 772.818420] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 772.818420] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73147567-8f06-4d30-aa7a-136f3fdfc02b with Priority: HIGHEST for action port [ 772.818650] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.818767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.818852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.820053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.820053] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.820815] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.820880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.821426] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-73147567-8f06-4d30-aa7a-136f3fdfc02b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.821623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73147567-8f06-4d30-aa7a-136f3fdfc02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.821743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73147567-8f06-4d30-aa7a-136f3fdfc02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.822052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73147567-8f06-4d30-aa7a-136f3fdfc02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.822158] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73147567-8f06-4d30-aa7a-136f3fdfc02b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.185984] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.186265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.186265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.186466] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.186557] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.186757] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.186857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.186947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.187093] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.187212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.187341] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 773.225916] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.229710] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.229859] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.230487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.230487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.241705] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 773.321684] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.321684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.327521] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 73147567-8f06-4d30-aa7a-136f3fdfc02b with status ACTIVE [ 773.327521] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.327521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.327521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.327521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.327521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.327521] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.327521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.327521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.327521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.327521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.327521] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.327521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.327521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.327521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.327521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.329449] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 73147567-8f06-4d30-aa7a-136f3fdfc02b is going to be updated. [ 773.370520] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.370704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.370747] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.370947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.371176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.371321] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73147567-8f06-4d30-aa7a-136f3fdfc02b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.719276] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: SUCCESS [ 773.721881] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 deletion is rescheduled due to dependency. [ 773.721881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.721881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.721881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.721881] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.721881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.721881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.721881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.721881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.721881] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.224472] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.525230] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 in Status: SUCCESS [ 774.525565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.525766] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.525991] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.526202] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.526327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.526394] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.526552] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.526630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.526714] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.526805] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.727415] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.029073] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.230799] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.231105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.231276] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.231755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.231755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.231949] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 is going to be updated. [ 775.253853] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 775.253853] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 deletion is rescheduled due to dependency. [ 775.253853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.268379] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.268568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.268608] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.268866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.269030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.281401] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: IN_PROGRESS for 2s [ 775.533738] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100: rpc.has_security_group_logging(os_id): False [ 775.559656] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.559876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.559984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.560338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.560820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.560896] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.562159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.562346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.562669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.562970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.562970] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 is going to be updated. [ 775.640052] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.640052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.640359] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.640896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.641123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.658532] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 in Status: IN_PROGRESS for 2s [ 776.704422] env[65413]: INFO networking_nsxv3.common.synchronization [req-4b2723b1-ef24-4172-81a3-88687ccb7654 req-9198ddad-2ec0-4cef-991a-bb00fb49c959 tempest-FloatingIPsAssociationTestJSON-939090825 tempest-FloatingIPsAssociationTestJSON-939090825-project-member] Enqueued Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_members [ 776.704981] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_members [ 776.705347] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-185b0179-79b1-4f7f-a796-e81c3eb7726c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.706826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.706826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.706826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.706826] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.706826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.706826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.706826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.706826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.707176] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.210344] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.290923] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: SUCCESS [ 777.291582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.291582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.291703] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.291798] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.291916] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.291982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.292154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.292236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.292320] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.292413] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.675062] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 in Status: SUCCESS [ 777.675312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.714317] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.795169] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.795370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.795370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.795563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.795756] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.795860] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.795929] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.796116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.796200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.796303] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.796456] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.796571] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.796630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.796785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.796934] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.797331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.797331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.797331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.797331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.797507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.797507] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.217890] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.217890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.217890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.217890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.217890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.217890] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c is going to be updated. [ 778.251035] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.251179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.251247] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.254083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.254083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.264484] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c in Status: IN_PROGRESS for 2s [ 778.303479] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d036f63-388f-4a40-b3dc-855ae378cbe3: rpc.has_security_group_logging(os_id): False [ 778.322950] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.323108] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.323175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.323386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.323468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.323675] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.323770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.323828] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.323975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.324058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.324249] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.324337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.324392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.324527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.324595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.324797] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.324847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.324903] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.325047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.325118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.325198] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 is going to be updated. [ 778.390126] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.390126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.390126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.390126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.391280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.406121] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: IN_PROGRESS for 2s [ 779.509309] env[65413]: INFO networking_nsxv3.common.synchronization [req-912802a6-d8b3-4c49-94ff-0f0c37aa5e30 req-0ce3304c-589b-4cd2-ad6b-5cc439ade805 tempest-ServersAdminNegativeTestJSON-1139809485 tempest-ServersAdminNegativeTestJSON-1139809485-project-member] Enqueued Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_members [ 779.509908] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_members [ 779.510244] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5899503-b7f8-4b26-9b77-05fdacbf5c20 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.510822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.510905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.511280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.511494] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.511606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.511662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.511898] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.512036] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.512166] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.015034] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.276588] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c in Status: SUCCESS [ 780.277090] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.424204] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: SUCCESS [ 780.424551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.517157] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.020479] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.020738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.020815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.021087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.021161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.021256] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 is going to be updated. [ 781.052875] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.053117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.053230] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.053530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.053795] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.065083] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 in Status: IN_PROGRESS for 2s [ 783.078619] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 in Status: SUCCESS [ 783.079125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.743946] env[65413]: INFO networking_nsxv3.common.synchronization [None req-f3a0d25e-ac32-415f-a6f2-ed57e2c8e813 tempest-ServerActionsTestJSON-1087044681 tempest-ServerActionsTestJSON-1087044681-project-member] Enqueued Resource ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 with Priority: HIGHEST for action security_group_rules [ 783.744503] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 with Priority: HIGHEST for action security_group_rules [ 783.744799] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.744921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.744986] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.746890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.746979] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7c33cf7-e412-4969-a4ca-045fd79b0e48',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.897683] env[65413]: INFO networking_nsxv3.common.synchronization [None req-085e798f-98d5-4645-a321-027acfc3457f tempest-ServerActionsTestJSON-1087044681 tempest-ServerActionsTestJSON-1087044681-project-member] Enqueued Resource ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 with Priority: HIGHEST for action security_group_rules [ 783.899877] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 with Priority: HIGHEST for action security_group_rules [ 783.901477] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.901617] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.284456] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.286559] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.286559] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.286559] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.286559] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.286559] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 already deleted. [ 784.286559] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.286559] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.286559] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.286559] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7c33cf7-e412-4969-a4ca-045fd79b0e48',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.757779] env[65413]: INFO networking_nsxv3.common.synchronization [req-47f2e138-879f-4267-995a-2a6cfa30a959 req-d0ee1f80-e502-4e9c-a5a3-f7620f0f4fb7 tempest-ListImageFiltersTestJSON-953550076 tempest-ListImageFiltersTestJSON-953550076-project-member] Enqueued Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_members [ 784.758520] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_members [ 784.759723] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6548500-a35c-4067-ba0a-a6f94326b3ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.759959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.760074] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.760355] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.760626] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.760767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.760836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.761014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.761100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.761195] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.810162] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.810349] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.810427] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.810648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.810802] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.810839] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 already deleted. [ 784.810920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.263660] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.542181] env[65413]: INFO networking_nsxv3.common.synchronization [req-70885989-b338-4ed2-8be7-3eb42b566d4d req-32aa25bd-39c8-4eca-9704-17b037e01046 tempest-InstanceActionsTestJSON-50475776 tempest-InstanceActionsTestJSON-50475776-project-member] Enqueued Resource ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 with Priority: HIGHEST for action security_group_members [ 785.542424] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 with Priority: HIGHEST for action security_group_members [ 785.542637] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-2204e101-51b2-465b-9a7b-c28fa89afdc1 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.542755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.542821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.543257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.543522] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.543581] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.543613] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.543770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.543864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.543957] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2204e101-51b2-465b-9a7b-c28fa89afdc1',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.766338] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.047731] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.047978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.047978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.048474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.048890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.049190] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.049355] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.049449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.049908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.049908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.049908] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 is going to be updated. [ 786.093899] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.094080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.094335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.094404] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.095030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.108579] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 in Status: IN_PROGRESS for 2s [ 786.269799] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.270193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.270431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.270780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.270985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.271203] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6548500-a35c-4067-ba0a-a6f94326b3ef is going to be updated. [ 786.276173] env[65413]: INFO networking_nsxv3.common.synchronization [req-0ea4d1a9-d489-4e96-a331-e9471982bda4 req-c53f88d8-2386-48c9-a435-45d8bf8c8201 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 786.276173] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 786.276173] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.276173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.276173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.276173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.276595] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.276827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.276980] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.277262] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.277450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.277627] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.314646] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.314852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.314852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.315082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.315226] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.328098] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6548500-a35c-4067-ba0a-a6f94326b3ef in Status: IN_PROGRESS for 2s [ 786.621631] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-187 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.621966] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.622853] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.623257] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.623546] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.623704] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.623814] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.624048] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.624185] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.624584] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.624584] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.624584] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.624722] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.624788] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.625497] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.625497] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.647048] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.647187] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 786.647225] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.647443] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.647738] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-82cb46a8-938d-4ef1-9866-74989426dd07 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.647904] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.648024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.648411] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.648543] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82cb46a8-938d-4ef1-9866-74989426dd07',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.781403] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.781556] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.781647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.782099] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.782099] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.782468] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.782468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.782468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.782468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.782662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.782662] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 already deleted. [ 786.782794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.150993] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.151169] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.151272] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.151678] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.151829] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.151988] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 82cb46a8-938d-4ef1-9866-74989426dd07 not found, creating... [ 787.152277] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.152437] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.152550] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.152793] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.152924] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.153243] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.153398] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.153522] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.153732] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.153863] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.154021] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 82cb46a8-938d-4ef1-9866-74989426dd07 is going to be created. [ 787.177448] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.177691] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.177751] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.178114] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.178474] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.178758] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.927511] env[65413]: INFO networking_nsxv3.common.synchronization [req-0ea4d1a9-d489-4e96-a331-e9471982bda4 req-cc804f6a-fa20-4c35-8468-ca8c29a9cb50 service nova] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_rules [ 787.929090] env[65413]: INFO networking_nsxv3.common.synchronization [req-0ea4d1a9-d489-4e96-a331-e9471982bda4 req-cc804f6a-fa20-4c35-8468-ca8c29a9cb50 service nova] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 787.929090] env[65413]: INFO networking_nsxv3.common.synchronization [req-0ea4d1a9-d489-4e96-a331-e9471982bda4 req-cc804f6a-fa20-4c35-8468-ca8c29a9cb50 service nova] Enqueued Resource ID: 82cb46a8-938d-4ef1-9866-74989426dd07 with Priority: HIGHEST for action port [ 787.930691] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_rules [ 787.930691] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 787.930783] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82cb46a8-938d-4ef1-9866-74989426dd07 with Priority: HIGHEST for action port [ 787.931106] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.931372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.931372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.933189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.933189] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.933189] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.933189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.933189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.933189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.935600] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.935780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.935823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.936063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.936146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.936752] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.937299] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-82cb46a8-938d-4ef1-9866-74989426dd07 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.937435] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.937494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.937713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.937784] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82cb46a8-938d-4ef1-9866-74989426dd07',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.122640] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 in Status: SUCCESS [ 788.122854] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2204e101-51b2-465b-9a7b-c28fa89afdc1 deletion is rescheduled due to dependency. [ 788.122986] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2204e101-51b2-465b-9a7b-c28fa89afdc1" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.339360] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6548500-a35c-4067-ba0a-a6f94326b3ef in Status: SUCCESS [ 788.339704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.441432] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.442722] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.443171] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.443745] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82cb46a8-938d-4ef1-9866-74989426dd07 with status ACTIVE [ 788.443999] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.444185] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.444256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.444665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.444853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.445057] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.445176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.445238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.445423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.445508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.445701] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.445800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.445864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.446016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.446104] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.446175] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82cb46a8-938d-4ef1-9866-74989426dd07 is going to be updated. [ 788.467877] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.467877] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.467877] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.468317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.468370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.468596] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.898720] env[65413]: INFO networking_nsxv3.common.synchronization [req-3fdef029-aa90-48ab-b929-35269096e424 req-3ff5ce34-d655-4b05-a7b5-8a7e540136f5 tempest-ServerMetadataNegativeTestJSON-1260870839 tempest-ServerMetadataNegativeTestJSON-1260870839-project-member] Enqueued Resource ID: dc6363fa-eea2-4547-9c1c-27fea8439578 with Priority: HIGHEST for action security_group_members [ 788.899344] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc6363fa-eea2-4547-9c1c-27fea8439578 with Priority: HIGHEST for action security_group_members [ 788.899724] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc6363fa-eea2-4547-9c1c-27fea8439578 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.899893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.899893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.900173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.900375] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.900527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.900616] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.900860] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.900977] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.901129] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc6363fa-eea2-4547-9c1c-27fea8439578',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.946232] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.353554] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-661 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.354238] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-661" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.354238] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-661" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.354238] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-661" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.357113] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.357113] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.357113] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.357113] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.357113] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.357113] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.357113] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.357113] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.357113] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.357113] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.357113] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.357113] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.378464] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.378464] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 789.378464] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.378464] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-661" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.378920] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-e85ce720-e96b-42a0-898c-f6c72c4f4052 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.378920] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-e85ce720-e96b-42a0-898c-f6c72c4f4052" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.378920] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-e85ce720-e96b-42a0-898c-f6c72c4f4052" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.379240] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-e85ce720-e96b-42a0-898c-f6c72c4f4052" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.379370] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e85ce720-e96b-42a0-898c-f6c72c4f4052',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.403975] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.403975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.403975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.404212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.404212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.404350] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.404463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.404526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.404713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.404821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.404928] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc6363fa-eea2-4547-9c1c-27fea8439578 already deleted. [ 789.405022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.449944] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.449944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.449944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.449944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.449944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.449944] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be created. [ 789.476046] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.476046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.476046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.476046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.476309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.487823] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: UNINITIALIZED for 2s [ 789.881795] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.882163] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.882337] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.882781] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.883138] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.883288] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port e85ce720-e96b-42a0-898c-f6c72c4f4052 not found, creating... [ 789.883652] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.883895] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.884100] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.884423] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.884627] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.885144] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.885390] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.885562] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.885868] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.886084] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.886298] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: e85ce720-e96b-42a0-898c-f6c72c4f4052 is going to be created. [ 789.910835] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.911706] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.911894] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.912273] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.912592] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.912885] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-e85ce720-e96b-42a0-898c-f6c72c4f4052" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.624097] env[65413]: INFO networking_nsxv3.common.synchronization [req-3fdef029-aa90-48ab-b929-35269096e424 req-b1a0c7dc-da43-40ed-b658-d5d9488a5ef6 service nova] Enqueued Resource ID: dc6363fa-eea2-4547-9c1c-27fea8439578 with Priority: HIGHEST for action security_group_rules [ 790.628110] env[65413]: INFO networking_nsxv3.common.synchronization [req-3fdef029-aa90-48ab-b929-35269096e424 req-b1a0c7dc-da43-40ed-b658-d5d9488a5ef6 service nova] Enqueued Resource ID: dc6363fa-eea2-4547-9c1c-27fea8439578 with Priority: HIGHEST for action security_group_members [ 790.628110] env[65413]: INFO networking_nsxv3.common.synchronization [req-3fdef029-aa90-48ab-b929-35269096e424 req-b1a0c7dc-da43-40ed-b658-d5d9488a5ef6 service nova] Enqueued Resource ID: e85ce720-e96b-42a0-898c-f6c72c4f4052 with Priority: HIGHEST for action port [ 790.628110] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc6363fa-eea2-4547-9c1c-27fea8439578 with Priority: HIGHEST for action security_group_rules [ 790.628110] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc6363fa-eea2-4547-9c1c-27fea8439578 with Priority: HIGHEST for action security_group_members [ 790.628110] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e85ce720-e96b-42a0-898c-f6c72c4f4052 with Priority: HIGHEST for action port [ 790.628110] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc6363fa-eea2-4547-9c1c-27fea8439578 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.628110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.628110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.628110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.628110] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc6363fa-eea2-4547-9c1c-27fea8439578',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.628110] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc6363fa-eea2-4547-9c1c-27fea8439578 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.628110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.628110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.628110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.628110] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.628110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.628110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.628110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.628110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.628110] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc6363fa-eea2-4547-9c1c-27fea8439578',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.628964] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-e85ce720-e96b-42a0-898c-f6c72c4f4052 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.628964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e85ce720-e96b-42a0-898c-f6c72c4f4052" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.628964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e85ce720-e96b-42a0-898c-f6c72c4f4052" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.628964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e85ce720-e96b-42a0-898c-f6c72c4f4052" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.628964] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e85ce720-e96b-42a0-898c-f6c72c4f4052',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.130561] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc6363fa-eea2-4547-9c1c-27fea8439578 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.130732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.130896] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc6363fa-eea2-4547-9c1c-27fea8439578',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.131889] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e85ce720-e96b-42a0-898c-f6c72c4f4052 with status ACTIVE [ 791.132084] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.132200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.132267] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.132475] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.132564] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.132729] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.132825] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.132887] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.133056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.133134] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.133312] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.133425] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.133457] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.133592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.133664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.133747] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e85ce720-e96b-42a0-898c-f6c72c4f4052 is going to be updated. [ 791.161383] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.161659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.161776] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.162239] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.162465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.162682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e85ce720-e96b-42a0-898c-f6c72c4f4052" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.501559] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 791.501780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.501950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.502192] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.502389] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.502511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.502575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.502735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.502813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.502897] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.502984] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.638076] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc6363fa-eea2-4547-9c1c-27fea8439578',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.685303] env[65413]: INFO networking_nsxv3.common.synchronization [req-02e0cd39-2891-49d7-8b08-4bdb8b8cacd8 req-481c1d6b-c418-4d0b-be9c-cb185e919651 tempest-ServerTagsTestJSON-298635232 tempest-ServerTagsTestJSON-298635232-project-member] Enqueued Resource ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 with Priority: HIGHEST for action security_group_members [ 791.686530] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 with Priority: HIGHEST for action security_group_members [ 791.686901] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.687088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.687189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.687491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.687698] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.687875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.688286] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.688528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.688683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.689030] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca89c8be-e3c6-40f6-87a3-7faf3a616f56',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.005554] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.005726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.005799] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.006034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.006210] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.006315] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.006374] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.006624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.006792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.006887] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.007133] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.007261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.007320] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.007517] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.007615] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.007708] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.007766] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.007902] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.007978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.008071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.008154] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.114167] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-851 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.114167] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-851" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.114167] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-851" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.114167] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-851" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.114468] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.114888] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.115351] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.115738] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.118710] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.118710] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 792.118710] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.118710] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.118710] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.118710] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 792.118710] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.118710] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.139985] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.139985] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 792.140162] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.140251] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-851" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.140647] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-1adf972b-add2-44fc-9924-8328cda0c777 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.141550] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-1adf972b-add2-44fc-9924-8328cda0c777" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.141550] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-1adf972b-add2-44fc-9924-8328cda0c777" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.141550] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-1adf972b-add2-44fc-9924-8328cda0c777" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.141550] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1adf972b-add2-44fc-9924-8328cda0c777',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.142419] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.143386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.143386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.143386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.143386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.143386] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc6363fa-eea2-4547-9c1c-27fea8439578 is going to be created. [ 792.168728] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.168912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.168976] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.169190] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.169350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.180857] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc6363fa-eea2-4547-9c1c-27fea8439578 in Status: UNINITIALIZED for 2s [ 792.191353] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.191522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.191582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.191782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.191884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.192072] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.192184] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.192359] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.192429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.192461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.192590] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 already deleted. [ 792.192692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.512919] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a6edb0e-97b9-43a5-ad22-81f0519d71f5: rpc.has_security_group_logging(os_id): False [ 792.550250] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.550250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.550250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.550250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.550250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.550250] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.550250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.550250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.550250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.550250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.550250] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.550250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.550250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.550250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.550250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.551312] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.551452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.551538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.551669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.551747] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.551838] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be created. [ 792.640875] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.640875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.640875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.641306] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.641306] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.645326] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.645470] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.645628] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.645933] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.646058] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.646168] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 1adf972b-add2-44fc-9924-8328cda0c777 not found, creating... [ 792.646445] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.646606] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.646714] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.646944] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.647089] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.647411] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.647564] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.647671] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.647971] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.648123] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.648293] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 1adf972b-add2-44fc-9924-8328cda0c777 is going to be created. [ 792.664658] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 792.687552] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.687915] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.688140] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.688577] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.688974] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.689328] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-1adf972b-add2-44fc-9924-8328cda0c777" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.406270] env[65413]: INFO networking_nsxv3.common.synchronization [req-02e0cd39-2891-49d7-8b08-4bdb8b8cacd8 req-729b7576-09c9-4a30-a414-9ac66693ca0f service nova] Enqueued Resource ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 with Priority: HIGHEST for action security_group_rules [ 793.406270] env[65413]: INFO networking_nsxv3.common.synchronization [req-02e0cd39-2891-49d7-8b08-4bdb8b8cacd8 req-729b7576-09c9-4a30-a414-9ac66693ca0f service nova] Enqueued Resource ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 with Priority: HIGHEST for action security_group_members [ 793.406270] env[65413]: INFO networking_nsxv3.common.synchronization [req-02e0cd39-2891-49d7-8b08-4bdb8b8cacd8 req-729b7576-09c9-4a30-a414-9ac66693ca0f service nova] Enqueued Resource ID: 1adf972b-add2-44fc-9924-8328cda0c777 with Priority: HIGHEST for action port [ 793.406270] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 with Priority: HIGHEST for action security_group_rules [ 793.406270] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 with Priority: HIGHEST for action security_group_members [ 793.406635] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1adf972b-add2-44fc-9924-8328cda0c777 with Priority: HIGHEST for action port [ 793.407443] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ca89c8be-e3c6-40f6-87a3-7faf3a616f56 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.407697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.407849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.408484] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.408757] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ca89c8be-e3c6-40f6-87a3-7faf3a616f56',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.409864] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.410167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.410361] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.411016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.411016] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.411016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.411016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.411332] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.411500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.411666] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca89c8be-e3c6-40f6-87a3-7faf3a616f56',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.415697] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-1adf972b-add2-44fc-9924-8328cda0c777 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.415697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1adf972b-add2-44fc-9924-8328cda0c777" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.415697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1adf972b-add2-44fc-9924-8328cda0c777" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.415697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1adf972b-add2-44fc-9924-8328cda0c777" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.415697] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1adf972b-add2-44fc-9924-8328cda0c777',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.915360] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.915688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.917849] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1adf972b-add2-44fc-9924-8328cda0c777 with status ACTIVE [ 793.918072] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.918208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.918268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.918505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.918596] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.918780] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.918878] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.918939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.919120] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.919195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.919373] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.919483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.919543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.919697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.919771] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.919850] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1adf972b-add2-44fc-9924-8328cda0c777 is going to be updated. [ 793.921677] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ca89c8be-e3c6-40f6-87a3-7faf3a616f56',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.946010] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.946268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.946268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.946498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.946595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.946763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1adf972b-add2-44fc-9924-8328cda0c777" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.193280] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc6363fa-eea2-4547-9c1c-27fea8439578 in Status: SUCCESS [ 794.193485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.193659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.193899] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.194160] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.194247] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.194299] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.194426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.194535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.194572] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.195332] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc6363fa-eea2-4547-9c1c-27fea8439578',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.424063] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ca89c8be-e3c6-40f6-87a3-7faf3a616f56',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.678401] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 794.678660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.703024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc6363fa-eea2-4547-9c1c-27fea8439578 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.703024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.703024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.703024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.703024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.703024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.703024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.703024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.703024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.703024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.703024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc6363fa-eea2-4547-9c1c-27fea8439578 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.703024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.703024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.703024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.703024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.703024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.703837] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.703837] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.703837] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.703837] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.703837] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc6363fa-eea2-4547-9c1c-27fea8439578',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.929024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.929024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.929024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.929024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.929024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.929024] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 is going to be created. [ 794.957571] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.957741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.957809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.958019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.958185] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.970995] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 in Status: UNINITIALIZED for 2s [ 794.975330] env[65413]: INFO networking_nsxv3.common.synchronization [req-90e04242-6846-4964-96a8-99a4f0b551f9 req-7fb5d587-19cd-46a3-a169-ecb6e15864bf tempest-ImagesOneServerNegativeTestJSON-1663656844 tempest-ImagesOneServerNegativeTestJSON-1663656844-project-member] Enqueued Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 794.976031] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 794.976195] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.976313] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.976381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.977035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.977035] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.977035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.977035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.977035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.977407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.977407] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.206853] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc6363fa-eea2-4547-9c1c-27fea8439578: rpc.has_security_group_logging(os_id): False [ 795.229235] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.229619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.229619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.229770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.229770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.229949] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.230131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.230258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.230538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.230710] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.230901] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.231010] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.231077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.231220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.231305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.231577] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.231577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.231686] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.231749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.231823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.232021] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc6363fa-eea2-4547-9c1c-27fea8439578 is going to be created. [ 795.243611] env[65413]: INFO networking_nsxv3.common.synchronization [None req-c13decf8-9e79-4a12-b64c-9b76e6755c50 tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b with Priority: HIGHEST for action security_group_rules [ 795.244273] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b with Priority: HIGHEST for action security_group_rules [ 795.244595] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.244722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.244789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.247728] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.247904] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.318105] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.318314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.318385] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.318597] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.318813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.336220] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc6363fa-eea2-4547-9c1c-27fea8439578 in Status: IN_PROGRESS for 2s [ 795.361551] env[65413]: INFO networking_nsxv3.common.synchronization [None req-74e0e815-e53e-46c4-879e-9263297a66cd tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b with Priority: HIGHEST for action security_group_rules [ 795.361980] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b with Priority: HIGHEST for action security_group_rules [ 795.362317] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.365021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.479608] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.479828] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.479905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.480314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.480314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.480609] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.480718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.480780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.480969] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.481049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.481138] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 is going to be updated. [ 795.519481] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.519772] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.519772] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.519915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.520040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.533420] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: IN_PROGRESS for 2s [ 795.772923] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.772923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.772923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.773262] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.773429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.773614] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b already deleted. [ 795.773848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.774062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.776191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.776191] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.207996] env[65413]: INFO networking_nsxv3.common.synchronization [req-11148918-6826-42e3-868c-259f60bbae09 req-904ce65c-a8bf-4a33-afa2-f531df9887c6 tempest-ServersAdminTestJSON-1071948959 tempest-ServersAdminTestJSON-1071948959-project-member] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 796.207996] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 796.208686] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.208831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.208891] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.209100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.209262] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.209459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.209459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.209574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.209627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.209798] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.306078] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.306435] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.306435] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.306727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.306842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.307083] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b already deleted. [ 796.307201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.711373] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.983457] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 in Status: SUCCESS [ 796.983709] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.983869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.984167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.984375] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.984556] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.984638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.984738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.984888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.984950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.985050] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ca89c8be-e3c6-40f6-87a3-7faf3a616f56',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.214498] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.348938] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc6363fa-eea2-4547-9c1c-27fea8439578 in Status: SUCCESS [ 797.349205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.487864] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.488086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.488189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.488495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.488721] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.488863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.488956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.489191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.489314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.489440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.489652] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.489788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.489876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.490091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.490366] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.490481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.490576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.490793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.490906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.491149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.491299] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ca89c8be-e3c6-40f6-87a3-7faf3a616f56',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.554266] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: SUCCESS [ 797.554481] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 deletion is rescheduled due to dependency. [ 797.554704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.718039] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.718200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.718276] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.718497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.718579] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.718674] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be updated. [ 797.753719] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.753887] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.753962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.754163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.754318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.773414] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: IN_PROGRESS for 2s [ 797.993742] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ca89c8be-e3c6-40f6-87a3-7faf3a616f56: rpc.has_security_group_logging(os_id): False [ 798.014471] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.014660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.014715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.014960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.015074] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.015303] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.015419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.015502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.015713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.015817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.016131] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.016288] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.016379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.016607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.016756] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.017038] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.017194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.017294] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.017496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.017629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.018267] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 is going to be created. [ 798.091036] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.091256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.091341] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.091682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.091896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.105298] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 in Status: IN_PROGRESS for 2s [ 799.786645] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 799.787470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.122848] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 in Status: SUCCESS [ 800.122848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.972871] env[65413]: INFO networking_nsxv3.common.synchronization [req-0bf170b2-e387-43db-89ca-381c36640c6a req-dc6fc90b-386f-466d-bc57-a31d2bd637c0 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGHEST for action security_group_members [ 800.973390] env[65413]: INFO networking_nsxv3.common.synchronization [req-0bf170b2-e387-43db-89ca-381c36640c6a req-dc6fc90b-386f-466d-bc57-a31d2bd637c0 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 800.974390] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGHEST for action security_group_members [ 800.974390] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 800.974531] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b12a08d1-d92e-480d-a458-27ffa6ee6832 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.974695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.974695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.975066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.975326] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.975490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.975599] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.975862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.976023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.976188] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.977344] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.977491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.977578] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.977751] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.977938] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.978066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.978135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.978315] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.978444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.978565] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.034964] env[65413]: INFO networking_nsxv3.common.synchronization [req-0bf170b2-e387-43db-89ca-381c36640c6a req-dc6fc90b-386f-466d-bc57-a31d2bd637c0 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_rules [ 801.035183] env[65413]: INFO networking_nsxv3.common.synchronization [req-0bf170b2-e387-43db-89ca-381c36640c6a req-dc6fc90b-386f-466d-bc57-a31d2bd637c0 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 801.035340] env[65413]: INFO networking_nsxv3.common.synchronization [req-0bf170b2-e387-43db-89ca-381c36640c6a req-dc6fc90b-386f-466d-bc57-a31d2bd637c0 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGHEST for action security_group_rules [ 801.035452] env[65413]: INFO networking_nsxv3.common.synchronization [req-0bf170b2-e387-43db-89ca-381c36640c6a req-dc6fc90b-386f-466d-bc57-a31d2bd637c0 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGHEST for action security_group_members [ 801.035595] env[65413]: INFO networking_nsxv3.common.synchronization [req-0bf170b2-e387-43db-89ca-381c36640c6a req-dc6fc90b-386f-466d-bc57-a31d2bd637c0 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 82cb46a8-938d-4ef1-9866-74989426dd07 with Priority: HIGHEST for action port [ 801.036280] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_rules [ 801.036459] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGHEST for action security_group_rules [ 801.036601] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82cb46a8-938d-4ef1-9866-74989426dd07 with Priority: HIGHEST for action port [ 801.037028] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 801.037139] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGHEST for action security_group_members [ 801.037421] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.037532] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.037596] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.037806] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.037889] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.039019] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b12a08d1-d92e-480d-a458-27ffa6ee6832 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.039019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.039019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.039292] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.039367] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.040185] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-82cb46a8-938d-4ef1-9866-74989426dd07 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.040350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.041440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.041440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.041440] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82cb46a8-938d-4ef1-9866-74989426dd07',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.041910] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.042135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.042253] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b12a08d1-d92e-480d-a458-27ffa6ee6832 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.042335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.480294] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.482342] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.543759] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b12a08d1-d92e-480d-a458-27ffa6ee6832 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.543759] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.543759] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.544054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.544054] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82cb46a8-938d-4ef1-9866-74989426dd07 with status ACTIVE [ 801.544182] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.544292] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.544356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.544633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.544728] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.544900] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.544997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.545079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.545264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.545350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.545523] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.545616] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.545681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.545839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.546093] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.546205] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82cb46a8-938d-4ef1-9866-74989426dd07 is going to be updated. [ 801.571816] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.571961] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.572043] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.572281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.572418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.572582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.807406] env[65413]: INFO networking_nsxv3.common.synchronization [req-fd2be412-a3d3-4663-bf1d-4fd7bd50c30d req-b8632e52-0c0f-4a7f-a7f2-d4aaaad59230 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGHEST for action security_group_members [ 801.807406] env[65413]: INFO networking_nsxv3.common.synchronization [req-fd2be412-a3d3-4663-bf1d-4fd7bd50c30d req-b8632e52-0c0f-4a7f-a7f2-d4aaaad59230 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 801.807406] env[65413]: INFO networking_nsxv3.common.synchronization [req-fd2be412-a3d3-4663-bf1d-4fd7bd50c30d req-b8632e52-0c0f-4a7f-a7f2-d4aaaad59230 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 93ea813f-4897-4022-881c-ff28bf9f5462 with Priority: HIGHEST for action security_group_members [ 801.808792] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGHEST for action security_group_members [ 801.809889] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 801.809889] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ea813f-4897-4022-881c-ff28bf9f5462 with Priority: HIGHEST for action security_group_members [ 801.809889] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b12a08d1-d92e-480d-a458-27ffa6ee6832 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.809889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.810514] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.810756] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.811906] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ea813f-4897-4022-881c-ff28bf9f5462 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.811906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.811906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.811906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.812900] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.813397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.813397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.813520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.813661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.813815] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93ea813f-4897-4022-881c-ff28bf9f5462',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.865019] env[65413]: INFO networking_nsxv3.common.synchronization [req-fd2be412-a3d3-4663-bf1d-4fd7bd50c30d req-b8632e52-0c0f-4a7f-a7f2-d4aaaad59230 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_rules [ 801.865019] env[65413]: INFO networking_nsxv3.common.synchronization [req-fd2be412-a3d3-4663-bf1d-4fd7bd50c30d req-b8632e52-0c0f-4a7f-a7f2-d4aaaad59230 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 801.865019] env[65413]: INFO networking_nsxv3.common.synchronization [req-fd2be412-a3d3-4663-bf1d-4fd7bd50c30d req-b8632e52-0c0f-4a7f-a7f2-d4aaaad59230 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 93ea813f-4897-4022-881c-ff28bf9f5462 with Priority: HIGHEST for action security_group_rules [ 801.865019] env[65413]: INFO networking_nsxv3.common.synchronization [req-fd2be412-a3d3-4663-bf1d-4fd7bd50c30d req-b8632e52-0c0f-4a7f-a7f2-d4aaaad59230 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 93ea813f-4897-4022-881c-ff28bf9f5462 with Priority: HIGHEST for action security_group_members [ 801.865019] env[65413]: INFO networking_nsxv3.common.synchronization [req-fd2be412-a3d3-4663-bf1d-4fd7bd50c30d req-b8632e52-0c0f-4a7f-a7f2-d4aaaad59230 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGHEST for action security_group_rules [ 801.865019] env[65413]: INFO networking_nsxv3.common.synchronization [req-fd2be412-a3d3-4663-bf1d-4fd7bd50c30d req-b8632e52-0c0f-4a7f-a7f2-d4aaaad59230 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGHEST for action security_group_members [ 801.865019] env[65413]: INFO networking_nsxv3.common.synchronization [req-fd2be412-a3d3-4663-bf1d-4fd7bd50c30d req-b8632e52-0c0f-4a7f-a7f2-d4aaaad59230 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 82cb46a8-938d-4ef1-9866-74989426dd07 with Priority: HIGHEST for action port [ 801.865977] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_rules [ 801.866414] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ea813f-4897-4022-881c-ff28bf9f5462 with Priority: HIGHEST for action security_group_rules [ 801.866933] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGHEST for action security_group_members [ 801.869805] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82cb46a8-938d-4ef1-9866-74989426dd07 with Priority: HIGHEST for action port [ 801.869805] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGHEST for action security_group_rules [ 801.869805] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 801.869805] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ea813f-4897-4022-881c-ff28bf9f5462 with Priority: HIGHEST for action security_group_members [ 801.869805] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.869805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.869805] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-93ea813f-4897-4022-881c-ff28bf9f5462 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.869805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.869805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.869805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.869805] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('93ea813f-4897-4022-881c-ff28bf9f5462',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.869805] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b12a08d1-d92e-480d-a458-27ffa6ee6832 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.869805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.870737] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-82cb46a8-938d-4ef1-9866-74989426dd07 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.871056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.871213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.871569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.871739] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82cb46a8-938d-4ef1-9866-74989426dd07',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.872930] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b12a08d1-d92e-480d-a458-27ffa6ee6832 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.874074] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.874712] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.874919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.875318] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ea813f-4897-4022-881c-ff28bf9f5462 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.875513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.983183] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 801.984659] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.317109] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93ea813f-4897-4022-881c-ff28bf9f5462',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.377434] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ea813f-4897-4022-881c-ff28bf9f5462 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.377434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.377434] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82cb46a8-938d-4ef1-9866-74989426dd07 with status ACTIVE [ 802.380044] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.380044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.380044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.380428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.382042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.382042] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.382042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.382042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.382042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.382042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.382042] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.382042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.382042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.382042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.382042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.382042] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82cb46a8-938d-4ef1-9866-74989426dd07 is going to be updated. [ 802.405569] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.406205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.406205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.406439] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.406981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.406981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82cb46a8-938d-4ef1-9866-74989426dd07" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.470245] env[65413]: INFO networking_nsxv3.common.synchronization [req-fe5cc428-57d5-4ae0-9b2e-1c70074a725f req-515f7a01-30af-4dfc-9fc2-bbb47a133be5 tempest-ServerActionsTestOtherB-69504015 tempest-ServerActionsTestOtherB-69504015-project-member] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 802.470819] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 802.471153] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.471270] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.471337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.471724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.471972] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.472121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.472204] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.472390] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.472471] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.472567] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.486378] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.486563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.486650] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.487023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.487323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.487496] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 is going to be created. [ 802.489691] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.489830] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.489888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.490128] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.490244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.490354] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 802.546560] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.546560] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.546754] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.546827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.547021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.552738] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.552738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.552738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.555213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.555213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.559328] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: UNINITIALIZED for 2s [ 802.567431] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 802.821498] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93ea813f-4897-4022-881c-ff28bf9f5462',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.932759] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.932759] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.932978] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.933407] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.934522] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.934522] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.934522] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.935296] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.935533] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.935814] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.936011] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.936237] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.936403] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.936573] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.936775] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.937040] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.964803] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.965244] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 802.965244] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.965515] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.965990] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-bda1a36a-76c0-468a-b6fe-0aa7690c3325 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.966326] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-bda1a36a-76c0-468a-b6fe-0aa7690c3325" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.966533] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-bda1a36a-76c0-468a-b6fe-0aa7690c3325" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.967101] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-bda1a36a-76c0-468a-b6fe-0aa7690c3325" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.968442] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bda1a36a-76c0-468a-b6fe-0aa7690c3325',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.978064] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.978198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.978283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.978478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.978660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.980086] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.980086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.980086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.980086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.980086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.980086] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded already deleted. [ 802.980482] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.322494] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.322913] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.322913] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.322913] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.323039] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.323147] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ea813f-4897-4022-881c-ff28bf9f5462 is going to be created. [ 803.355030] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.355248] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.355354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.355851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.355851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.369327] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ea813f-4897-4022-881c-ff28bf9f5462 in Status: UNINITIALIZED for 2s [ 803.472083] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.472369] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.472491] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.472770] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.472909] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.473077] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port bda1a36a-76c0-468a-b6fe-0aa7690c3325 not found, creating... [ 803.473447] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.473641] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.473799] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.474143] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.474356] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.474793] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.475049] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.475247] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.475799] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.475799] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.475925] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: bda1a36a-76c0-468a-b6fe-0aa7690c3325 is going to be created. [ 803.496752] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.496966] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.497110] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.497423] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.497665] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.497883] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-bda1a36a-76c0-468a-b6fe-0aa7690c3325" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.283598] env[65413]: INFO networking_nsxv3.common.synchronization [req-fe5cc428-57d5-4ae0-9b2e-1c70074a725f req-a46acf87-50b3-4b81-aedb-3d1e15e9b533 service nova] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_rules [ 804.285056] env[65413]: INFO networking_nsxv3.common.synchronization [req-fe5cc428-57d5-4ae0-9b2e-1c70074a725f req-a46acf87-50b3-4b81-aedb-3d1e15e9b533 service nova] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 804.285056] env[65413]: INFO networking_nsxv3.common.synchronization [req-fe5cc428-57d5-4ae0-9b2e-1c70074a725f req-a46acf87-50b3-4b81-aedb-3d1e15e9b533 service nova] Enqueued Resource ID: bda1a36a-76c0-468a-b6fe-0aa7690c3325 with Priority: HIGHEST for action port [ 804.285056] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_rules [ 804.285056] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 804.285056] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bda1a36a-76c0-468a-b6fe-0aa7690c3325 with Priority: HIGHEST for action port [ 804.286187] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.287545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.287545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.287545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.287545] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.289270] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.289438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.289531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.290084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.290713] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.290713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.290713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.290896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.291018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.291142] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.292473] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-bda1a36a-76c0-468a-b6fe-0aa7690c3325 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.292635] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bda1a36a-76c0-468a-b6fe-0aa7690c3325" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.292726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bda1a36a-76c0-468a-b6fe-0aa7690c3325" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.292916] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bda1a36a-76c0-468a-b6fe-0aa7690c3325" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.293046] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bda1a36a-76c0-468a-b6fe-0aa7690c3325',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.572218] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: SUCCESS [ 804.572671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.572671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.572803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.573102] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.573274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.573321] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.573487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.573586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.573684] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.575269] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 804.575465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.575682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.575916] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.576133] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.576272] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.576342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.576498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.576578] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.576691] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.796043] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.797016] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.797186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.797408] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bda1a36a-76c0-468a-b6fe-0aa7690c3325 with status ACTIVE [ 804.797632] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.797753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.797819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.798045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.798132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.798325] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.798427] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.798845] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.798845] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.798845] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.799293] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.799448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.799533] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.799719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.799839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.799920] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bda1a36a-76c0-468a-b6fe-0aa7690c3325 is going to be updated. [ 804.824894] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.824894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.824894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.825383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.825383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.825383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bda1a36a-76c0-468a-b6fe-0aa7690c3325" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.078711] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.080116] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.302736] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.380487] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ea813f-4897-4022-881c-ff28bf9f5462 in Status: SUCCESS [ 805.380694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.380863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.381118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.381341] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.381432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.381511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.381668] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.381749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.381845] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93ea813f-4897-4022-881c-ff28bf9f5462',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.582036] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.583074] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.805921] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.808079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.808385] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.808723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.808902] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.809089] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded is going to be created. [ 805.839032] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.839032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.839032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.839032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.839032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.849613] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: UNINITIALIZED for 2s [ 805.884618] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('93ea813f-4897-4022-881c-ff28bf9f5462',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.086075] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.086075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.086075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.086075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.086075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.086075] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 is going to be updated. [ 806.088516] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.088516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.088516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.088516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.088784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.088826] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 806.161327] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.161507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.161507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.161840] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.162101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.166672] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.166672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.166672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.166862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.166942] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.184025] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 806.185547] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: IN_PROGRESS for 2s [ 806.388366] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('93ea813f-4897-4022-881c-ff28bf9f5462',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.891993] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.892324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.892324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.894348] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.894348] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.894348] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ea813f-4897-4022-881c-ff28bf9f5462 is going to be updated. [ 806.925629] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.925810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.925880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.926110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.926243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.950715] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ea813f-4897-4022-881c-ff28bf9f5462 in Status: IN_PROGRESS for 2s [ 807.861976] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: SUCCESS [ 807.862228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.862403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.862623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.863067] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.863251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.863321] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.863551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.863674] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.863778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.863939] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.195299] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: SUCCESS [ 808.195545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.195677] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.197086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.197086] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.197086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.197086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.197086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.197086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.197086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.197086] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.198845] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 808.198845] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.198845] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.199021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.199214] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.199326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.199391] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.200011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.200011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.200011] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.201026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.201026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.201026] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.201284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.201284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.201378] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.201437] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.202321] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.202321] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.202866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.203026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.203258] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.203412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.203530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.205621] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.205621] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.205621] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.371020] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.655400] env[65413]: INFO networking_nsxv3.common.synchronization [req-2cccf121-2b91-43cd-9083-2d4e1e632d2b req-09d21195-5c37-406a-91eb-950dcf0a9ee6 tempest-ServerMetadataNegativeTestJSON-1260870839 tempest-ServerMetadataNegativeTestJSON-1260870839-project-member] Enqueued Resource ID: dc6363fa-eea2-4547-9c1c-27fea8439578 with Priority: HIGHEST for action security_group_members [ 808.655842] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc6363fa-eea2-4547-9c1c-27fea8439578 with Priority: HIGHEST for action security_group_members [ 808.656753] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc6363fa-eea2-4547-9c1c-27fea8439578 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.657169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.657169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.657299] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.657481] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.657599] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.657708] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.657907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.657995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.658103] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc6363fa-eea2-4547-9c1c-27fea8439578',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.704191] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.706631] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.707205] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.708045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.708045] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.873636] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4aeeb11-908b-4980-9ebd-3c96e2724ded: rpc.has_security_group_logging(os_id): False [ 808.895419] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.895576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.895650] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.895881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.895965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.896211] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.896317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.896380] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.896529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.896606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.896689] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded is going to be created. [ 808.962407] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ea813f-4897-4022-881c-ff28bf9f5462 in Status: SUCCESS [ 808.963015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.963253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.963476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.963810] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.963810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.963935] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.964031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.964137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.964202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.964335] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('93ea813f-4897-4022-881c-ff28bf9f5462',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.966440] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.966586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.966645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.966865] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.967144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.981184] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: IN_PROGRESS for 2s [ 809.161920] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.162094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.162166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.163574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.163720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.163978] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.164086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.164153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.164349] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.164431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.164522] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc6363fa-eea2-4547-9c1c-27fea8439578 is going to be updated. [ 809.196712] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.197049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.197049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.197205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.197286] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.206906] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc6363fa-eea2-4547-9c1c-27fea8439578 in Status: IN_PROGRESS for 2s [ 809.207436] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.210075] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b12a08d1-d92e-480d-a458-27ffa6ee6832: rpc.has_security_group_logging(os_id): False [ 809.211148] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.234144] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.234144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.234144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.234144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.234144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.234144] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.234144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.234144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.234144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.234144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.234144] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 is going to be created. [ 809.298600] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.298722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.298810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.299044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.299236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.313279] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: IN_PROGRESS for 2s [ 809.469132] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('93ea813f-4897-4022-881c-ff28bf9f5462',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.709904] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.709997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.710044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.710265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.710391] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.710542] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 is going to be updated. [ 809.713463] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.713593] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.713665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.713845] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.713926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.714033] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 809.746101] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.746262] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.746334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.746555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.746764] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.748721] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.748869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.748911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.749199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.749268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.762108] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 809.762899] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: IN_PROGRESS for 2s [ 809.974078] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 93ea813f-4897-4022-881c-ff28bf9f5462: rpc.has_security_group_logging(os_id): False [ 809.993755] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.993971] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.994096] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.994349] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.994443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.994762] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.994881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.994981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.995294] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.995378] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.995470] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 93ea813f-4897-4022-881c-ff28bf9f5462 is going to be created. [ 810.055395] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.055568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.055612] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.055832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.056018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.067546] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93ea813f-4897-4022-881c-ff28bf9f5462 in Status: IN_PROGRESS for 2s [ 811.001426] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: SUCCESS [ 811.001859] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.226614] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc6363fa-eea2-4547-9c1c-27fea8439578 in Status: IN_PROGRESS for 4s [ 811.326321] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: SUCCESS [ 811.326624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.326853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.327131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.327235] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.656058] env[65413]: INFO networking_nsxv3.common.synchronization [req-d9b4a11a-10c0-4316-8640-94ab00cf5e46 req-6b4bd0a4-fece-4f0e-913f-97fcd846bb7c tempest-ServerTagsTestJSON-298635232 tempest-ServerTagsTestJSON-298635232-project-member] Enqueued Resource ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 with Priority: HIGHEST for action security_group_members [ 811.656592] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 with Priority: HIGHEST for action security_group_members [ 811.656920] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.657159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.657245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.657449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.657608] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.657715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.657772] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.657914] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.657999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.658105] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ca89c8be-e3c6-40f6-87a3-7faf3a616f56',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.774079] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 811.774428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.774696] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.774983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.775299] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.775483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.775594] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.776478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.776478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.776478] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.778581] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: SUCCESS [ 811.778752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.778898] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.779082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.779246] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.779353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.779414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.779570] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.779643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.779742] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.832033] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b12a08d1-d92e-480d-a458-27ffa6ee6832 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.832201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.083520] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 93ea813f-4897-4022-881c-ff28bf9f5462 in Status: SUCCESS [ 812.083919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.161026] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.161354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.161354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.161723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.161879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.162185] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.162296] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.162296] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.162640] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.162770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.162870] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 is going to be updated. [ 812.196889] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.197137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.197137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.197403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.197640] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.210579] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 in Status: IN_PROGRESS for 2s [ 812.260724] env[65413]: INFO networking_nsxv3.common.synchronization [req-b4c6e1df-6e85-4802-82c4-48697b8ab862 req-da61f897-bf8b-47d7-bd9f-de7a4a500ff3 tempest-FloatingIPsAssociationTestJSON-939090825 tempest-FloatingIPsAssociationTestJSON-939090825-project-member] Enqueued Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_members [ 812.261514] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c with Priority: HIGHEST for action security_group_members [ 812.261777] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-185b0179-79b1-4f7f-a796-e81c3eb7726c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.261986] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.262196] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.262461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.262669] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.262803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.262871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.263157] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.263198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.263290] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('185b0179-79b1-4f7f-a796-e81c3eb7726c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.282088] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.282564] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.766079] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.766079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.766079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.766250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.766288] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.766541] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.766664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.766739] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.766928] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.767037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.767133] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c is going to be updated. [ 812.786821] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.787722] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.801856] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.801856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.801856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.802108] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.802245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.815733] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c in Status: IN_PROGRESS for 2s [ 813.237905] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc6363fa-eea2-4547-9c1c-27fea8439578 in Status: SUCCESS [ 813.238219] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc6363fa-eea2-4547-9c1c-27fea8439578 deletion is rescheduled due to dependency. [ 813.238286] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.290158] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.290389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.290440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.290739] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.290834] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.290933] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 813.292488] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.292488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.292488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.292704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.292760] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.292846] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 is going to be updated. [ 813.340176] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.340176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.340176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.340176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.340176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.342264] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.342382] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.342451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.342917] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.343193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.360053] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 813.360890] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: IN_PROGRESS for 2s [ 814.220831] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 in Status: SUCCESS [ 814.221024] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ca89c8be-e3c6-40f6-87a3-7faf3a616f56 deletion is rescheduled due to dependency. [ 814.221144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ca89c8be-e3c6-40f6-87a3-7faf3a616f56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.827947] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c in Status: SUCCESS [ 814.828295] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 185b0179-79b1-4f7f-a796-e81c3eb7726c deletion is rescheduled due to dependency. [ 814.828295] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-185b0179-79b1-4f7f-a796-e81c3eb7726c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.202313] env[65413]: INFO networking_nsxv3.common.synchronization [req-e2daf9df-c8ad-4f4e-a80f-3045a4d20a52 req-9b1f7738-da8a-4ca4-9816-582fef043749 tempest-ServersAdminNegativeTestJSON-1139809485 tempest-ServersAdminNegativeTestJSON-1139809485-project-member] Enqueued Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_members [ 815.202887] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGHEST for action security_group_members [ 815.203255] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e5899503-b7f8-4b26-9b77-05fdacbf5c20 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.203383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.203469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.204064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.204064] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.204064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.204064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.204306] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.204399] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.205028] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.373274] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 815.373487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.373669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.374778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.374778] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.374778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.374778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.374778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.374778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.374778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.375253] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.375253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.375253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.378116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.378297] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.378414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.378542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.378663] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.378759] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.378806] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.379339] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.380611] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: SUCCESS [ 815.380801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.380976] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.381157] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.381633] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.381633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.381633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.381633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.381941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.381941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.381941] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.530458] env[65413]: INFO networking_nsxv3.common.synchronization [req-59bc9bc6-fd2e-430f-b632-a660aa19c6a7 req-93712b5e-f729-463c-8e33-8ae4b82cb600 tempest-ImagesTestJSON-1309992501 tempest-ImagesTestJSON-1309992501-project-member] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 815.531022] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 815.531337] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.531463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.532547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.532852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.532852] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.532955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.532955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.534028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.534028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.534028] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.709456] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.709456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.709456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.709456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.709456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.709456] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.709456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.709877] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.709877] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.709877] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.709973] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 is going to be updated. [ 815.739636] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.739636] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.739636] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.739636] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.739991] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.750465] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 in Status: IN_PROGRESS for 2s [ 815.885545] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a6edb0e-97b9-43a5-ad22-81f0519d71f5: rpc.has_security_group_logging(os_id): False [ 815.885545] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.906257] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.906485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.906580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.906808] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.906890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.907151] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.908472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.908472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.908472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.908472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.908472] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.908472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.908820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.908820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.910032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.910032] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.910032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.910032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.910032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.910032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.910032] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 815.942115] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-954 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.942115] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.942115] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.942115] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.942115] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.942115] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.942115] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.942115] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.942115] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.943286] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.943403] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.943699] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.943699] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.948645] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.948645] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.948645] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.970445] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.970700] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 815.970757] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.971229] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.971229] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-5cc3a9df-c4cc-4426-8816-1811f71f3f16 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.971562] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-5cc3a9df-c4cc-4426-8816-1811f71f3f16" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.971562] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-5cc3a9df-c4cc-4426-8816-1811f71f3f16" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.971945] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-5cc3a9df-c4cc-4426-8816-1811f71f3f16" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.972157] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cc3a9df-c4cc-4426-8816-1811f71f3f16',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.978186] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.978268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.980911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.980911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.980911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.993494] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 816.036793] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.036793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.036793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.036793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.036793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.036793] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.036793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.036793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.036793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.036793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.037355] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 816.114627] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.114627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.114627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.114627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.114627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.131779] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 816.390373] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b12a08d1-d92e-480d-a458-27ffa6ee6832: rpc.has_security_group_logging(os_id): False [ 816.411237] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.412392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.412392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.412392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.412392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.412392] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.412392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.412392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.412725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.412725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.412785] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 is going to be updated. [ 816.476894] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.477245] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.477441] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.477783] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.477997] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.478219] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 5cc3a9df-c4cc-4426-8816-1811f71f3f16 not found, creating... [ 816.478560] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.478816] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.479009] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.479438] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.479740] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.480122] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.480347] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.480589] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.480751] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.480938] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.481114] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 5cc3a9df-c4cc-4426-8816-1811f71f3f16 is going to be created. [ 816.495262] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.495262] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.495379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.496035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.496035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.507465] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.507465] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.507465] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.507465] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.507465] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.507465] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-5cc3a9df-c4cc-4426-8816-1811f71f3f16" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.510428] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: IN_PROGRESS for 2s [ 817.258508] env[65413]: INFO networking_nsxv3.common.synchronization [req-59bc9bc6-fd2e-430f-b632-a660aa19c6a7 req-c0641e53-fae5-4cb4-9f07-f80d8d1575e9 service nova] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_rules [ 817.258760] env[65413]: INFO networking_nsxv3.common.synchronization [req-59bc9bc6-fd2e-430f-b632-a660aa19c6a7 req-c0641e53-fae5-4cb4-9f07-f80d8d1575e9 service nova] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 817.258815] env[65413]: INFO networking_nsxv3.common.synchronization [req-59bc9bc6-fd2e-430f-b632-a660aa19c6a7 req-c0641e53-fae5-4cb4-9f07-f80d8d1575e9 service nova] Enqueued Resource ID: 5cc3a9df-c4cc-4426-8816-1811f71f3f16 with Priority: HIGHEST for action port [ 817.259473] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_rules [ 817.259746] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 817.259936] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cc3a9df-c4cc-4426-8816-1811f71f3f16 with Priority: HIGHEST for action port [ 817.262136] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.262212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.262282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.262534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.262619] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.264320] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.264975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.269347] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cc3a9df-c4cc-4426-8816-1811f71f3f16 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.269347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cc3a9df-c4cc-4426-8816-1811f71f3f16" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.269347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cc3a9df-c4cc-4426-8816-1811f71f3f16" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.269593] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cc3a9df-c4cc-4426-8816-1811f71f3f16" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.269688] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cc3a9df-c4cc-4426-8816-1811f71f3f16',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.763323] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 in Status: SUCCESS [ 817.763525] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 deletion is rescheduled due to dependency. [ 817.763641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.771271] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.771412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.772820] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5cc3a9df-c4cc-4426-8816-1811f71f3f16 with status ACTIVE [ 817.773050] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.773181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.773257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.773454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.773539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.773716] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.773803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.773869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.774031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.774109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.774289] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.774406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.774438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.774571] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.774802] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.774802] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5cc3a9df-c4cc-4426-8816-1811f71f3f16 is going to be updated. [ 817.803915] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.804129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.804214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.804438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.804592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.804781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cc3a9df-c4cc-4426-8816-1811f71f3f16" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.015964] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 818.015964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.015964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.015964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.015964] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.065065] env[65413]: INFO networking_nsxv3.common.synchronization [req-d1b8f047-22d9-443e-b6b2-a0b6e488752d req-e0bf4b9f-0463-48bf-b867-d7b2ef0ce199 tempest-DeleteServersTestJSON-2008533967 tempest-DeleteServersTestJSON-2008533967-project-member] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 818.065792] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 818.066100] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.066655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.066729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.066937] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.067137] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.067244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.067345] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.067456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.067594] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.067659] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.146294] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 818.146490] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 deletion is rescheduled due to dependency. [ 818.146607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.146782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.146999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.147204] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.147324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.147383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.147542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.147623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.147766] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.456801] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-586 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.457150] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.457150] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.457443] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.457812] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.458027] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.458199] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.458457] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.458630] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.458841] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.458946] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 818.459069] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 818.459172] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 818.459272] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 818.459369] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 818.459493] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 818.486819] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 818.487011] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 818.487153] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 818.487321] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.487780] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-1f5a6b13-1d44-4d50-aead-c343d873deba taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.487912] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-1f5a6b13-1d44-4d50-aead-c343d873deba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.487912] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-1f5a6b13-1d44-4d50-aead-c343d873deba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.488285] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-1f5a6b13-1d44-4d50-aead-c343d873deba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.488445] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f5a6b13-1d44-4d50-aead-c343d873deba',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.518912] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.519146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.519198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.519400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.519614] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.519794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.519794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.520693] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.520693] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.520693] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.520693] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.524053] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: SUCCESS [ 818.524053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.574009] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.576995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.576995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.576995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.576995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.576995] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.576995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.576995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.576995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.576995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.576995] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 818.609024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.609024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.609024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.609024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.609024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.618922] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 818.650052] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.991110] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.991430] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.991521] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.991769] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.991912] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.992077] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 1f5a6b13-1d44-4d50-aead-c343d873deba not found, creating... [ 818.992351] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.992492] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.992598] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.992813] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.992990] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.993333] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.993493] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.993595] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.993796] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.993921] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.994062] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 1f5a6b13-1d44-4d50-aead-c343d873deba is going to be created. [ 819.014884] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.015154] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.015298] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.015672] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.015954] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.016016] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-1f5a6b13-1d44-4d50-aead-c343d873deba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.022754] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.022968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.023055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.023259] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.023422] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.023521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.023592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.023713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.023798] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.023880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.024032] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.024129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.024265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.024360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.024360] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.024675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.024675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.024794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.024854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.024930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.025026] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.112174] env[65413]: INFO networking_nsxv3.common.synchronization [req-6f972d65-89bc-4731-809a-8c558ad144b9 req-87d8fbec-68f3-4404-9539-1e600d75597b tempest-ServersTestFqdnHostnames-958389924 tempest-ServersTestFqdnHostnames-958389924-project-member] Enqueued Resource ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 with Priority: HIGHEST for action security_group_members [ 819.112677] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 with Priority: HIGHEST for action security_group_members [ 819.113034] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0022fbcd-322d-4db7-a1a1-6693d137e213 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.113156] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.113224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.113439] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.113597] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.113702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.113763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.113910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.113994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.114101] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0022fbcd-322d-4db7-a1a1-6693d137e213',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.152376] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.531136] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a6edb0e-97b9-43a5-ad22-81f0519d71f5: rpc.has_security_group_logging(os_id): False [ 819.551524] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.551744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.551985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.556210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.556314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.556585] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.556704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.556769] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.556958] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.557180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.557256] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.557358] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.557461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.558238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.558729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.558729] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.558848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.558848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.558973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.559087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.559178] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 819.618017] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.618017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.618017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.618017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.618017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.618017] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.618017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.618017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.618017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.618527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.618527] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 is going to be updated. [ 819.634606] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.634785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.634836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.635480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.635480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.654736] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.654902] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.654975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.655221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.655315] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.655490] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 819.661887] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 819.665185] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.665397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.665511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.665753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.665936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.684623] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 in Status: IN_PROGRESS for 2s [ 819.725452] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.725452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.725452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.725452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.725452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.737974] env[65413]: INFO networking_nsxv3.common.synchronization [req-d1b8f047-22d9-443e-b6b2-a0b6e488752d req-4bc5dae5-fe38-4318-96c0-f4ca70410328 service nova] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_rules [ 819.738254] env[65413]: INFO networking_nsxv3.common.synchronization [req-d1b8f047-22d9-443e-b6b2-a0b6e488752d req-4bc5dae5-fe38-4318-96c0-f4ca70410328 service nova] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 819.738326] env[65413]: INFO networking_nsxv3.common.synchronization [req-d1b8f047-22d9-443e-b6b2-a0b6e488752d req-4bc5dae5-fe38-4318-96c0-f4ca70410328 service nova] Enqueued Resource ID: 1f5a6b13-1d44-4d50-aead-c343d873deba with Priority: HIGHEST for action port [ 819.739866] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 819.740381] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_rules [ 819.740615] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 819.740749] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f5a6b13-1d44-4d50-aead-c343d873deba with Priority: HIGHEST for action port [ 819.741054] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.741377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.741377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.742091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.742192] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.744884] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.744884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.744884] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f5a6b13-1d44-4d50-aead-c343d873deba taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.744884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f5a6b13-1d44-4d50-aead-c343d873deba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.744884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f5a6b13-1d44-4d50-aead-c343d873deba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.744884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f5a6b13-1d44-4d50-aead-c343d873deba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.744884] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f5a6b13-1d44-4d50-aead-c343d873deba',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.249326] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.249467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.249622] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f5a6b13-1d44-4d50-aead-c343d873deba with status ACTIVE [ 820.249828] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.249996] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.250082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.250307] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.250493] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.250761] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.250865] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.250919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.251098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.251171] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.251405] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.251492] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.251560] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.251838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.251838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.252084] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f5a6b13-1d44-4d50-aead-c343d873deba is going to be updated. [ 820.292098] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.292426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.292619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.292913] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.293087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.293256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f5a6b13-1d44-4d50-aead-c343d873deba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.631302] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 820.631752] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 deletion is rescheduled due to dependency. [ 820.631752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.631898] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.632129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.632236] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.632362] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.632427] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.632951] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.632951] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.632951] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.135410] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.637421] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.679322] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 821.680097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.694424] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 in Status: SUCCESS [ 821.694608] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0022fbcd-322d-4db7-a1a1-6693d137e213 deletion is rescheduled due to dependency. [ 821.694715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0022fbcd-322d-4db7-a1a1-6693d137e213" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.751971] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 821.752230] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.752360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.752723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.752957] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.753152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.753256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.753392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.753476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.753628] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.753723] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.140574] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.140761] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.140841] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.141061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.141151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.141242] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 822.175820] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.175820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.175820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.176158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.176158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.186431] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 822.256090] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.256259] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.256413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.258866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.258866] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.258866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.258866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.258866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.258866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.258866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.258866] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.258866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.258866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.258866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.258866] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.258866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.258866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.258866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.258866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.258866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.258866] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.760809] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 650f4003-0da8-43a0-bfde-c7d15e589861: rpc.has_security_group_logging(os_id): False [ 822.781846] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.782065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.783050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.783050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.783050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.783050] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.783050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.783050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.783050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.783503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.783503] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.783503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.783633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.783785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.783862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.784105] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.784237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.784334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.784511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.784614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.784723] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 822.861788] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.862045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.862127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.862357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.862509] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.888756] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 823.742205] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.742481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.742481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.742692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.742804] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.199885] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 824.200225] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.200347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.200595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.200797] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.200923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.200988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.201173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.201269] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.201366] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.201457] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.249438] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.705494] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.705665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.705705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.705910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.706122] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.706224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.706289] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.707812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.707921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.708034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.708234] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.708339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.708401] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.708591] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.708739] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.708833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.708893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.709066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.709148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.709244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.709338] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.741722] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 824.741870] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 824.752677] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.903783] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 824.904303] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.212974] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d96dd8be-7e0f-4527-b6b4-1fd21b89c256: rpc.has_security_group_logging(os_id): False [ 825.234172] env[65413]: INFO networking_nsxv3.common.synchronization [req-66ca32f3-f4ac-41a7-9cff-a8b52dc94ace req-748a8a1b-4f8c-49cb-a8d6-04ebb8c6b6d9 tempest-ListImageFiltersTestJSON-953550076 tempest-ListImageFiltersTestJSON-953550076-project-member] Enqueued Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_members [ 825.234172] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGHEST for action security_group_members [ 825.234172] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b6548500-a35c-4067-ba0a-a6f94326b3ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.234358] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.234358] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.234576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.236063] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.236063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.236063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.236063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.236286] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.236286] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.240187] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.240187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.240187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.240187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.240187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.241087] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.241950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.241950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.241950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.241950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.242670] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.245021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.245021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.245021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.245021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.245021] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.245021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.245021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.245021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.245021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.245021] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 825.255409] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 825.255569] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 825.319658] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.319658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.319658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.320045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.320294] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.340757] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 825.739180] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.739342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.739383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.739609] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.768058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.768316] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.768437] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.768503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.768717] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.768796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.768880] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6548500-a35c-4067-ba0a-a6f94326b3ef is going to be updated. [ 825.797362] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.797512] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.797577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.797799] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.797939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.807466] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6548500-a35c-4067-ba0a-a6f94326b3ef in Status: IN_PROGRESS for 2s [ 825.996869] env[65413]: INFO networking_nsxv3.common.synchronization [req-7ee12d7d-c97e-4f96-977e-8afdd3d921b6 req-05797e06-894e-4e6b-845d-b9982feb6ed9 tempest-ServerActionsTestJSON-1087044681 tempest-ServerActionsTestJSON-1087044681-project-member] Enqueued Resource ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 with Priority: HIGHEST for action security_group_members [ 825.997667] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 with Priority: HIGHEST for action security_group_members [ 825.998398] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c33cf7-e412-4969-a4ca-045fd79b0e48 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.998398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.998398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.998596] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.998682] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.998769] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.998823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.999176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.999176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.999176] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7c33cf7-e412-4969-a4ca-045fd79b0e48',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.369562] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.370100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.370100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.370100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.529952] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 826.530835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.531878] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 826.533369] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.533523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.533598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.533816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.533909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.534145] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.534311] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.534380] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.534587] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.534669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.534769] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 already deleted. [ 826.534866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.537666] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-56 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.537835] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.537946] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.538182] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.538414] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.538577] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.538678] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.538871] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.538993] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.539196] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.539297] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.539394] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.539489] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.539585] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.539680] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.539797] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.563923] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.564119] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.564119] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.564283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.569060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.569489] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 826.569575] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.569657] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 826.571875] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.571875] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 826.571875] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.572147] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.572496] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-19606f71-5550-4f76-9c31-d7cf190a3c83 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.572644] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-19606f71-5550-4f76-9c31-d7cf190a3c83" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.572794] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-19606f71-5550-4f76-9c31-d7cf190a3c83" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.573084] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-19606f71-5550-4f76-9c31-d7cf190a3c83" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.573218] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19606f71-5550-4f76-9c31-d7cf190a3c83',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.612062] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.612217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.612284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.612631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.614132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.614132] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 826.675758] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.676070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.676070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.676497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.676540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.676754] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 826.740034] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.740248] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.740320] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.740545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.740839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.741323] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:37. [ 826.741458] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'fcfdc2e3-2cc7-44cc-8355-9f87d267f435', 'b6548500-a35c-4067-ba0a-a6f94326b3ef', 'b12a08d1-d92e-480d-a458-27ffa6ee6832', '7a6edb0e-97b9-43a5-ad22-81f0519d71f5', 'bbe38081-099a-4476-a2e0-88f6c84557ca', '832015c1-81fd-4bf2-88c3-58e97531a611', '7541a263-2861-4b4d-ab51-2db5044fecf7', 'aa7226ef-74d4-482f-ac1d-bbefed534583', 'f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c', '07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3', 'd31c425c-609d-448d-bad8-0a938d0bf8ef', '9c56a7ec-65f7-4b28-8303-747aa0500c3b', 'cf0b2b30-620f-460d-be6e-f4b8fb0907c6', '69363ac6-cdf1-4edb-9d06-998638037b3e', '650f4003-0da8-43a0-bfde-c7d15e589861', 'e5899503-b7f8-4b26-9b77-05fdacbf5c20', '0a7fc932-3592-4bfb-af13-f30854471e39', '58d03374-02a8-4013-ba8d-fa57c3795178', 'c42ae76b-69ae-499f-b565-4ede857c249b', 'af248d88-efaa-44cd-99ca-972413455b63', 'dc6363fa-eea2-4547-9c1c-27fea8439578', 'f4aeeb11-908b-4980-9ebd-3c96e2724ded', 'fd87052e-7745-4df2-93d7-5efc42c58438', '7b3bad9e-4f10-4e75-bf3f-69836f779f28', '0022fbcd-322d-4db7-a1a1-6693d137e213', '3d036f63-388f-4a40-b3dc-855ae378cbe3', '185b0179-79b1-4f7f-a796-e81c3eb7726c', '9b9c29e6-4adf-4695-9f0a-75daeb6daeb9', '93ea813f-4897-4022-881c-ff28bf9f5462', '74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100', 'ca89c8be-e3c6-40f6-87a3-7faf3a616f56', '1945c8c9-d5b5-4111-ba8b-cb310537a2d4', 'd96dd8be-7e0f-4527-b6b4-1fd21b89c256', 'cd34bb24-11b2-4ccc-9316-b0c847939508', '2204e101-51b2-465b-9a7b-c28fa89afdc1', '58542666-ecc3-4c4c-bed5-143746872487', '14ffed21-0b3b-46f2-aece-160a014b9767'} {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.741563] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 826.763383] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.763614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.763614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.763843] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.763932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.764059] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 826.764129] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.764197] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 826.825302] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.825450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.825515] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.825723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.826423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.826623] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 826.826842] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 826.826842] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 826.826842] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 826.826964] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/37 resources of Type:Security Group Rules [ 826.826964] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGH for action security_group_rules [ 826.827045] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGH for action security_group_rules [ 826.827089] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGH for action security_group_rules [ 826.827145] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGH for action security_group_rules [ 826.827206] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bbe38081-099a-4476-a2e0-88f6c84557ca with Priority: HIGH for action security_group_rules [ 826.827268] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 832015c1-81fd-4bf2-88c3-58e97531a611 with Priority: HIGH for action security_group_rules [ 826.827329] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 with Priority: HIGH for action security_group_rules [ 826.827417] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGH for action security_group_rules [ 826.827454] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c with Priority: HIGH for action security_group_rules [ 826.827491] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 with Priority: HIGH for action security_group_rules [ 826.827551] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGH for action security_group_rules [ 826.827611] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGH for action security_group_rules [ 826.827694] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 with Priority: HIGH for action security_group_rules [ 826.827762] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGH for action security_group_rules [ 826.827824] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGH for action security_group_rules [ 826.827886] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGH for action security_group_rules [ 826.827947] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0a7fc932-3592-4bfb-af13-f30854471e39 with Priority: HIGH for action security_group_rules [ 826.828016] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGH for action security_group_rules [ 826.828080] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGH for action security_group_rules [ 826.828141] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGH for action security_group_rules [ 826.828237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.076017] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.076297] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.076419] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.076788] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.076938] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.077098] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 19606f71-5550-4f76-9c31-d7cf190a3c83 not found, creating... [ 827.077363] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.077513] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.077623] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.077835] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.077962] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.078259] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.078406] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.078524] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.078913] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.079048] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.079232] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 19606f71-5550-4f76-9c31-d7cf190a3c83 is going to be created. [ 827.100198] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.100443] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.100560] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.100853] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.101110] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.101306] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-19606f71-5550-4f76-9c31-d7cf190a3c83" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.356594] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 827.357336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.678599] env[65413]: INFO networking_nsxv3.common.synchronization [req-7ee12d7d-c97e-4f96-977e-8afdd3d921b6 req-1eac16b5-491c-4c3e-bbc3-4444ef0d1528 service nova] Enqueued Resource ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 with Priority: HIGHEST for action security_group_rules [ 827.678887] env[65413]: INFO networking_nsxv3.common.synchronization [req-7ee12d7d-c97e-4f96-977e-8afdd3d921b6 req-1eac16b5-491c-4c3e-bbc3-4444ef0d1528 service nova] Enqueued Resource ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 with Priority: HIGHEST for action security_group_members [ 827.678940] env[65413]: INFO networking_nsxv3.common.synchronization [req-7ee12d7d-c97e-4f96-977e-8afdd3d921b6 req-1eac16b5-491c-4c3e-bbc3-4444ef0d1528 service nova] Enqueued Resource ID: 19606f71-5550-4f76-9c31-d7cf190a3c83 with Priority: HIGHEST for action port [ 827.679471] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 with Priority: HIGHEST for action security_group_rules [ 827.679647] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 with Priority: HIGHEST for action security_group_members [ 827.679703] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19606f71-5550-4f76-9c31-d7cf190a3c83 with Priority: HIGHEST for action port [ 827.679802] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGH for action security_group_rules [ 827.679897] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGH for action security_group_rules [ 827.679989] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 with Priority: HIGH for action security_group_rules [ 827.680323] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGH for action security_group_rules [ 827.680579] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGH for action security_group_rules [ 827.680774] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42ae76b-69ae-499f-b565-4ede857c249b with Priority: HIGH for action security_group_rules [ 827.680964] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 58d03374-02a8-4013-ba8d-fa57c3795178 with Priority: HIGH for action security_group_rules [ 827.681071] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0a7fc932-3592-4bfb-af13-f30854471e39 with Priority: HIGH for action security_group_rules [ 827.681159] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGH for action security_group_rules [ 827.681754] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 with Priority: HIGH for action security_group_rules [ 827.681885] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 with Priority: HIGH for action security_group_rules [ 827.681990] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGH for action security_group_rules [ 827.682089] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGH for action security_group_rules [ 827.682232] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 with Priority: HIGH for action security_group_rules [ 827.682280] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c with Priority: HIGH for action security_group_rules [ 827.682346] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 832015c1-81fd-4bf2-88c3-58e97531a611 with Priority: HIGH for action security_group_rules [ 827.682428] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa7226ef-74d4-482f-ac1d-bbefed534583 with Priority: HIGH for action security_group_rules [ 827.682734] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbe38081-099a-4476-a2e0-88f6c84557ca with Priority: HIGH for action security_group_rules [ 827.682734] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6548500-a35c-4067-ba0a-a6f94326b3ef with Priority: HIGH for action security_group_rules [ 827.682734] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGH for action security_group_rules [ 827.682986] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.683124] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.683184] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.683397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.683475] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7c33cf7-e412-4969-a4ca-045fd79b0e48',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.688946] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c33cf7-e412-4969-a4ca-045fd79b0e48 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.689117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.689165] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.689363] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.689522] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.689620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.689694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.691194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.691313] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.691395] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7c33cf7-e412-4969-a4ca-045fd79b0e48',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.692407] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-19606f71-5550-4f76-9c31-d7cf190a3c83 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.693672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19606f71-5550-4f76-9c31-d7cf190a3c83" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.693853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19606f71-5550-4f76-9c31-d7cf190a3c83" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.694088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19606f71-5550-4f76-9c31-d7cf190a3c83" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.694175] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19606f71-5550-4f76-9c31-d7cf190a3c83',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.695764] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.695905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.695969] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.696160] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.696242] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcfdc2e3-2cc7-44cc-8355-9f87d267f435',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.697582] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b12a08d1-d92e-480d-a458-27ffa6ee6832 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.697693] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.697756] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.697945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.698031] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.699902] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7541a263-2861-4b4d-ab51-2db5044fecf7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.699902] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.699902] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.700313] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.700397] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7541a263-2861-4b4d-ab51-2db5044fecf7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.701763] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.701923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.701923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.702736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.702736] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.703574] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.703684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.703753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.703900] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.705204] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.705864] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c42ae76b-69ae-499f-b565-4ede857c249b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.705992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.706046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.706189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.706256] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c42ae76b-69ae-499f-b565-4ede857c249b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.707718] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-58d03374-02a8-4013-ba8d-fa57c3795178 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.707851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.707907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.708474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.708474] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('58d03374-02a8-4013-ba8d-fa57c3795178',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.709469] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0a7fc932-3592-4bfb-af13-f30854471e39 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.709673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.709673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.710294] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.710294] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0a7fc932-3592-4bfb-af13-f30854471e39',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.710294] env[65413]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 827.711511] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.712175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.712175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.712175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.712175] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.713539] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e5899503-b7f8-4b26-9b77-05fdacbf5c20 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.713661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.713740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.713860] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.713941] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e5899503-b7f8-4b26-9b77-05fdacbf5c20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.717542] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf0b2b30-620f-460d-be6e-f4b8fb0907c6 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.717542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.717542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.717542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.717542] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf0b2b30-620f-460d-be6e-f4b8fb0907c6',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.718535] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.718673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.718784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.719148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.719784] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.720063] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.720169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.720234] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.720380] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.720454] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.721343] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.721477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.721545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.721644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.721715] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.722700] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.722810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.722877] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.723419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.723522] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.724429] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-832015c1-81fd-4bf2-88c3-58e97531a611 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.724567] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.724693] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.724789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.724885] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('832015c1-81fd-4bf2-88c3-58e97531a611',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.725734] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa7226ef-74d4-482f-ac1d-bbefed534583 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.725871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.725931] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.726065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.726138] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa7226ef-74d4-482f-ac1d-bbefed534583',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.727064] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bbe38081-099a-4476-a2e0-88f6c84557ca taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.727208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.727255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.727381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.727449] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bbe38081-099a-4476-a2e0-88f6c84557ca',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.727738] env[65413]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 827.728434] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b6548500-a35c-4067-ba0a-a6f94326b3ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.728540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.728609] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.728749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.728815] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b6548500-a35c-4067-ba0a-a6f94326b3ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.729838] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.729944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.730461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.730461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.730461] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.734526] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 19606f71-5550-4f76-9c31-d7cf190a3c83 with status ACTIVE [ 827.734808] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.734929] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.734989] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.735249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.736217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.736217] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.736217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.736217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.736217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.736217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.736217] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.736217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.736217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.736941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.736941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.736941] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 19606f71-5550-4f76-9c31-d7cf190a3c83 is going to be updated. [ 827.773168] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.773415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.773415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.773588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.773718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.773865] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19606f71-5550-4f76-9c31-d7cf190a3c83" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.819267] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b6548500-a35c-4067-ba0a-a6f94326b3ef in Status: SUCCESS [ 827.819410] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b6548500-a35c-4067-ba0a-a6f94326b3ef deletion is rescheduled due to dependency. [ 827.819539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.233343] env[65413]: INFO networking_nsxv3.common.synchronization [None req-ab6f7555-c421-402e-b4c3-65c1b31450b6 None None] Enqueued Resource ID: 2887336f-ab02-4811-b1c8-1c0628e97f91 with Priority: HIGHEST for action port [ 828.233838] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c33cf7-e412-4969-a4ca-045fd79b0e48 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.233965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.236952] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2887336f-ab02-4811-b1c8-1c0628e97f91 with Priority: HIGHEST for action port [ 828.236952] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-2887336f-ab02-4811-b1c8-1c0628e97f91 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.236952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2887336f-ab02-4811-b1c8-1c0628e97f91" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.236952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2887336f-ab02-4811-b1c8-1c0628e97f91" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.236952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2887336f-ab02-4811-b1c8-1c0628e97f91" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.236952] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2887336f-ab02-4811-b1c8-1c0628e97f91',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.239915] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7c33cf7-e412-4969-a4ca-045fd79b0e48',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.285275] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.285791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.286050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.286960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.286960] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.287285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.287780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.287780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.287780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.288150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.289028] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.289840] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.290188] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.290413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.291115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.291397] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.292038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.292038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.292280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.293465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.293465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.293465] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.293720] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.293994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.294169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.294581] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.294828] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.295048] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.295202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.295433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.295803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.295803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.297035] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.298891] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.299034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.299131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.299314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.299490] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.299602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.299668] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.299834] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.299873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.299951] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.300024] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.310701] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.310865] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.310936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.311273] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.311416] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.312854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.312854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.312854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.312854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.312854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.312854] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fcfdc2e3-2cc7-44cc-8355-9f87d267f435',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.313215] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b12a08d1-d92e-480d-a458-27ffa6ee6832 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.313215] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.313215] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.313388] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.313427] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.313598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.313598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.313714] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.313774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.313853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.313931] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.316055] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.316173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.316217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.316374] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.316517] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.316721] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.316787] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.316934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.317019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.317102] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.317184] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.320593] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.320753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.320831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.321008] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.321215] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.321317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.321378] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.321526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.321623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.321744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.321849] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.364462] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.364649] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.364717] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.365223] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.373391] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.373739] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.375172] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.375172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.375972] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.376115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.376907] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.377024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.378133] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.378247] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.379202] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.379202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.382273] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.382273] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.382951] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.383086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.383923] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.384115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.384978] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.385099] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.386142] env[65413]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 828.386579] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.386683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.390754] env[65413]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 828.391903] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.391903] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c is going to be deleted. [ 828.392874] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.393112] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.414263] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.414549] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 58d03374-02a8-4013-ba8d-fa57c3795178 is going to be deleted. [ 828.415412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.416035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.436471] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.436471] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7541a263-2861-4b4d-ab51-2db5044fecf7 is going to be deleted. [ 828.437911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.438164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.459259] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.459390] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.467135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.467135] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c42ae76b-69ae-499f-b565-4ede857c249b is going to be deleted. [ 828.467135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.467379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.479518] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.479658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.487630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.487789] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf0b2b30-620f-460d-be6e-f4b8fb0907c6 is going to be deleted. [ 828.489336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.489586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.511347] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.511490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.529074] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.529074] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b6548500-a35c-4067-ba0a-a6f94326b3ef is going to be deleted. [ 828.530141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.530330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.577549] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.577925] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa7226ef-74d4-482f-ac1d-bbefed534583 is going to be deleted. [ 828.579195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.579195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.595888] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.596035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.596757] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.596897] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.629333] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.629333] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e5899503-b7f8-4b26-9b77-05fdacbf5c20 is going to be deleted. [ 828.629611] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.629966] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.699601] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.699939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.705805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.705952] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0a7fc932-3592-4bfb-af13-f30854471e39 is going to be deleted. [ 828.707048] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.707158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.740287] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2887336f-ab02-4811-b1c8-1c0628e97f91 [ 828.742055] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.742055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.742055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.742055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.742055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.742055] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2887336f-ab02-4811-b1c8-1c0628e97f91 already deleted. [ 828.742055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2887336f-ab02-4811-b1c8-1c0628e97f91" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.742777] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7c33cf7-e412-4969-a4ca-045fd79b0e48',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.759325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.759325] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 832015c1-81fd-4bf2-88c3-58e97531a611 is going to be deleted. [ 828.764667] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.764667] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.768438] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.768438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.808054] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.808054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.808054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.808978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.808978] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.808978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.808978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.808978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.808978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.808978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.809303] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.809303] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.809303] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.809414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.809448] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.809554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.809616] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.810871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.810871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.810871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.810871] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.811239] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.811353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.811419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.812535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.813418] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.813418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.813418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.813418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.813418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.813418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.813418] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.813941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.813941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.814033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.814105] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.814195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.814251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.815120] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.815120] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.815120] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.815120] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.818245] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.818372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.819047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.819047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.819047] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.819047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.819047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.819293] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.819293] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.819293] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.819409] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.819469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.819518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.819643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.819766] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.819868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.819927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.820358] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.820358] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.820358] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.820358] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.821203] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.830693] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.832124] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fcfdc2e3-2cc7-44cc-8355-9f87d267f435',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.832972] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.834298] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.834524] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.834524] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.834705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.834927] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.835069] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.835164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.835304] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.835379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.835521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.835652] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.835709] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.835756] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.835884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.836059] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.838012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.838012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.838012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.838012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.838012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.838012] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.872670] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.872840] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.874957] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.874957] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.875785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.875929] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bbe38081-099a-4476-a2e0-88f6c84557ca is going to be deleted. [ 828.878042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.878042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.910032] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.910518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.920865] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.921084] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3 is going to be deleted. [ 828.923088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.923088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.923088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.923088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f3ff3dfd-9a4e-4a93-ae0d-deb6efe7d86c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.923088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.923088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.923088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.923088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-58d03374-02a8-4013-ba8d-fa57c3795178" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.923924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.923924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.923924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.923924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7541a263-2861-4b4d-ab51-2db5044fecf7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.924150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.924206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.924308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.924409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf0b2b30-620f-460d-be6e-f4b8fb0907c6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.924532] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.924680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.924763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.924841] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c42ae76b-69ae-499f-b565-4ede857c249b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.924960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.925190] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.925190] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.925330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b6548500-a35c-4067-ba0a-a6f94326b3ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.926815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.926815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.926815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.926815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa7226ef-74d4-482f-ac1d-bbefed534583" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.926815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.926815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.926815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.926815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e5899503-b7f8-4b26-9b77-05fdacbf5c20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.926815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.926815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.926815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.926815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0a7fc932-3592-4bfb-af13-f30854471e39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.926815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.926815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.928447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.928447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-832015c1-81fd-4bf2-88c3-58e97531a611" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.022784] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.022784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.022784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.022784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.023349] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.023349] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bbe38081-099a-4476-a2e0-88f6c84557ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.047230] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.048377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.048377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.048377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.048377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.048377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-07d74ce0-fd03-4b2f-a8e4-d40d37ceedf3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.248881] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.249221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.249341] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.249691] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.249865] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.250095] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 is going to be created. [ 829.283529] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.283868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.283868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.284210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.284210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.307683] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 in Status: UNINITIALIZED for 2s [ 829.323313] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a6edb0e-97b9-43a5-ad22-81f0519d71f5: rpc.has_security_group_logging(os_id): False [ 829.324785] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af248d88-efaa-44cd-99ca-972413455b63: rpc.has_security_group_logging(os_id): False [ 829.325911] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 650f4003-0da8-43a0-bfde-c7d15e589861: rpc.has_security_group_logging(os_id): False [ 829.326962] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d31c425c-609d-448d-bad8-0a938d0bf8ef: rpc.has_security_group_logging(os_id): False [ 829.332530] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c56a7ec-65f7-4b28-8303-747aa0500c3b: rpc.has_security_group_logging(os_id): False [ 829.335125] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fcfdc2e3-2cc7-44cc-8355-9f87d267f435: rpc.has_security_group_logging(os_id): False [ 829.337995] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b12a08d1-d92e-480d-a458-27ffa6ee6832: rpc.has_security_group_logging(os_id): False [ 829.339068] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 69363ac6-cdf1-4edb-9d06-998638037b3e: rpc.has_security_group_logging(os_id): False [ 829.356474] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.356739] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.356739] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.358251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.358940] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.359107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.360358] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.360484] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.362045] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.362244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.363127] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.363290] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.363944] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.364084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.372556] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.372762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.374805] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.374976] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.386733] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.387172] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.387290] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.387344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.387588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.387673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.387772] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef is going to be updated. [ 829.388996] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.389241] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.418171] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.418529] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.419133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.419258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.419500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.419599] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.419723] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 is going to be updated. [ 829.421026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.421243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.444758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.445132] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.445299] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.445410] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.445540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.445615] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.445829] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.445954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.446046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.446182] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.446254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.446482] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.446602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.446671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.446765] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.446844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.446926] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be updated. [ 829.448235] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.448407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.477674] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.478370] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.478370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.478589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.478687] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.478780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.478956] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b is going to be updated. [ 829.480595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.480896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.485408] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.485649] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.507605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.507939] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.508088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.508154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.508402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.508589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.508822] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.508964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.509068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.509167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.509243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.509425] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.509504] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.509566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.509935] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.509935] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.509935] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 829.511163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.511330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.514190] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.514271] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.529573] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.529740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.558029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.558029] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.558029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.558029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.558029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.558029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.558029] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.558029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.558029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.558029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.558029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.558029] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.558029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.558029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.559023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.559023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.559023] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af248d88-efaa-44cd-99ca-972413455b63 is going to be updated. [ 829.560263] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.560538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.606666] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.608608] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.620211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.620480] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.620839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.620968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.621571] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.622129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.622430] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.622539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.622613] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.622805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.624318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.624318] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.624318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.624318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.624318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.624318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.624318] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 829.625052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.625253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.700463] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.700463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.717635] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.717845] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.717924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.718069] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.718322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.718632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.718632] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 is going to be updated. [ 829.720753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.720948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.721103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.722217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.722607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.722607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.723502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.723706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.723886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.724751] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.724924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.725067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.726582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.726815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.726928] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.768494] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: IN_PROGRESS for 2s [ 829.769484] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: IN_PROGRESS for 2s [ 829.791935] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: IN_PROGRESS for 2s [ 829.802358] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 in Status: IN_PROGRESS for 2s [ 829.808762] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 829.850400] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.850705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.850705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.851221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.851221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.892634] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 829.901346] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.901533] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.901634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.901896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.902104] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.947131] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: IN_PROGRESS for 2s [ 829.976043] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.976389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.976389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.977536] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.977844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.018518] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: IN_PROGRESS for 2s [ 830.704231] env[65413]: INFO networking_nsxv3.common.synchronization [req-6344ebad-4414-47b5-89ec-6227b0ed9649 req-1dae1604-1f79-41d0-9604-dae8b58d8151 tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b with Priority: HIGHEST for action security_group_members [ 830.704231] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b with Priority: HIGHEST for action security_group_members [ 830.704231] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.704231] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.704231] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.704231] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.704231] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.704231] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.704231] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.704877] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.704877] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.704877] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.905212] env[65413]: INFO networking_nsxv3.common.synchronization [None req-af2cd3ca-63c3-44cf-8f6e-400d7b60735c None None] Enqueued Resource ID: 48de625f-6a42-4f67-91b0-2649aba7fad8 with Priority: HIGHEST for action port [ 830.905212] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48de625f-6a42-4f67-91b0-2649aba7fad8 with Priority: HIGHEST for action port [ 830.906562] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-48de625f-6a42-4f67-91b0-2649aba7fad8 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.906721] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48de625f-6a42-4f67-91b0-2649aba7fad8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.906824] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48de625f-6a42-4f67-91b0-2649aba7fad8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.907212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48de625f-6a42-4f67-91b0-2649aba7fad8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.907341] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48de625f-6a42-4f67-91b0-2649aba7fad8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.205834] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-210 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.206114] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.206290] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.206588] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.206857] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.207087] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.207248] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.207503] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.207679] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.208674] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.208674] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.208674] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.208674] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.208674] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.208674] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.208674] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.210997] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.212047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.212047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.212047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.212047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.212047] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.212047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.212047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.212462] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.212462] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.212643] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b already deleted. [ 831.213231] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.255504] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.255687] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.047 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 831.255822] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.255992] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.256409] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-74c19c5d-5662-4249-85b2-115d368c38ef taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.256583] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-74c19c5d-5662-4249-85b2-115d368c38ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.256711] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-74c19c5d-5662-4249-85b2-115d368c38ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.257087] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-74c19c5d-5662-4249-85b2-115d368c38ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.257238] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74c19c5d-5662-4249-85b2-115d368c38ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.319859] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 in Status: SUCCESS [ 831.319859] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.319859] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.319859] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.320245] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.320245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.320245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.320368] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.320368] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.320435] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.323086] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7c33cf7-e412-4969-a4ca-045fd79b0e48',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.410486] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 48de625f-6a42-4f67-91b0-2649aba7fad8 [ 831.411382] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.411795] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.411942] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.412583] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.412909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.413063] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:48de625f-6a42-4f67-91b0-2649aba7fad8 already deleted. [ 831.413183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48de625f-6a42-4f67-91b0-2649aba7fad8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.554296] env[65413]: INFO networking_nsxv3.common.synchronization [req-435a13ea-4c4e-45d4-bc99-ab579c3e27da req-374813c4-eede-4381-bd0f-c5e1bc2e311e tempest-ServersAdminTestJSON-1071948959 tempest-ServersAdminTestJSON-1071948959-project-member] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 831.554889] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 831.555241] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.555368] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.555436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.555639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.555791] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.555923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.556023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.556205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.556289] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.556401] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.762804] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.763276] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.763276] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.763462] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.763604] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.763812] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 74c19c5d-5662-4249-85b2-115d368c38ef not found, creating... [ 831.764108] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.764269] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.764380] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.764601] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.764731] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.765015] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.765168] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.765360] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.765480] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.765601] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.765730] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 74c19c5d-5662-4249-85b2-115d368c38ef is going to be created. [ 831.785660] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: SUCCESS [ 831.785907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.787101] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: SUCCESS [ 831.787198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.790940] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.791305] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.791305] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.791545] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.791879] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.792104] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-74c19c5d-5662-4249-85b2-115d368c38ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.811739] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 831.812015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.821270] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 in Status: SUCCESS [ 831.823836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.826167] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7c33cf7-e412-4969-a4ca-045fd79b0e48',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.830704] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 831.830944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.928403] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 831.928709] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.965302] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: SUCCESS [ 831.965302] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.036211] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: SUCCESS [ 832.036384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.058938] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.329046] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7c33cf7-e412-4969-a4ca-045fd79b0e48: rpc.has_security_group_logging(os_id): False [ 832.359020] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.359020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.359020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.359020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.359020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.359020] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.359020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.359020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.359020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.359020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.359020] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 is going to be created. [ 832.464166] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.464394] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.464394] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.464581] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.464764] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.479565] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 in Status: IN_PROGRESS for 2s [ 832.534235] env[65413]: INFO networking_nsxv3.common.synchronization [req-6344ebad-4414-47b5-89ec-6227b0ed9649 req-14801b02-bb2e-4ce8-8e93-afc804bd1a27 service nova] Enqueued Resource ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b with Priority: HIGHEST for action security_group_rules [ 832.534420] env[65413]: INFO networking_nsxv3.common.synchronization [req-6344ebad-4414-47b5-89ec-6227b0ed9649 req-14801b02-bb2e-4ce8-8e93-afc804bd1a27 service nova] Enqueued Resource ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b with Priority: HIGHEST for action security_group_members [ 832.534560] env[65413]: INFO networking_nsxv3.common.synchronization [req-6344ebad-4414-47b5-89ec-6227b0ed9649 req-14801b02-bb2e-4ce8-8e93-afc804bd1a27 service nova] Enqueued Resource ID: 74c19c5d-5662-4249-85b2-115d368c38ef with Priority: HIGHEST for action port [ 832.535285] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b with Priority: HIGHEST for action security_group_rules [ 832.535465] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b with Priority: HIGHEST for action security_group_members [ 832.535539] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74c19c5d-5662-4249-85b2-115d368c38ef with Priority: HIGHEST for action port [ 832.535848] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.535972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.536075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.536274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.536361] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.537979] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.538288] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.538357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.538573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.538750] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.538858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.538915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.539097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.539335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.539335] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.541625] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-74c19c5d-5662-4249-85b2-115d368c38ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.541625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74c19c5d-5662-4249-85b2-115d368c38ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.541625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74c19c5d-5662-4249-85b2-115d368c38ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.541625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74c19c5d-5662-4249-85b2-115d368c38ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.542371] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74c19c5d-5662-4249-85b2-115d368c38ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.561983] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.038434] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.039448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.044057] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 74c19c5d-5662-4249-85b2-115d368c38ef with status ACTIVE [ 833.044299] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.044547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.044547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.044768] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.044854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.045050] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.045134] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.046041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.046041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.046041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.046041] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.046041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.046041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.046041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.046041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.046041] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 74c19c5d-5662-4249-85b2-115d368c38ef is going to be updated. [ 833.047218] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.064442] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.064595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.064668] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.064945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.065136] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.065232] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be updated. [ 833.071089] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.071241] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.071287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.071618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.071824] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.072011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74c19c5d-5662-4249-85b2-115d368c38ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.107200] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.107200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.107200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.107200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.107200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.127049] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: IN_PROGRESS for 2s [ 833.551253] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.053134] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.053444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.053444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.053640] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.053743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.053848] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b is going to be created. [ 834.097597] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.097817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.097817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.098037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.098194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.109486] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b in Status: UNINITIALIZED for 2s [ 834.492290] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 in Status: SUCCESS [ 834.492518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.138911] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 835.139255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.120896] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b in Status: SUCCESS [ 836.121727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.122089] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.122488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.123158] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.123360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.123434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.123635] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.123719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.123909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.123909] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.627464] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.697210] env[65413]: INFO networking_nsxv3.common.synchronization [None req-4499aafc-799b-4701-aa01-1295a52529af None None] Enqueued Resource ID: 12d03e0a-3fad-436e-a3e6-8e71e2e8a8d7 with Priority: HIGHEST for action port [ 836.697210] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12d03e0a-3fad-436e-a3e6-8e71e2e8a8d7 with Priority: HIGHEST for action port [ 836.698031] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-12d03e0a-3fad-436e-a3e6-8e71e2e8a8d7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.699927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12d03e0a-3fad-436e-a3e6-8e71e2e8a8d7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.699927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12d03e0a-3fad-436e-a3e6-8e71e2e8a8d7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.699927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12d03e0a-3fad-436e-a3e6-8e71e2e8a8d7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.699927] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12d03e0a-3fad-436e-a3e6-8e71e2e8a8d7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.132248] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b: rpc.has_security_group_logging(os_id): False [ 837.153241] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.153466] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.153466] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.154398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.154398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.154398] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.154398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.154398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.154398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.154398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.154857] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b is going to be created. [ 837.205154] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12d03e0a-3fad-436e-a3e6-8e71e2e8a8d7 [ 837.205154] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.205154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.205154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.205154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.205154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.205154] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12d03e0a-3fad-436e-a3e6-8e71e2e8a8d7 already deleted. [ 837.205154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12d03e0a-3fad-436e-a3e6-8e71e2e8a8d7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.220335] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.220475] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.220543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.220805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.221010] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.235035] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b in Status: IN_PROGRESS for 2s [ 839.260698] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b in Status: SUCCESS [ 839.260698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.702775] env[65413]: INFO networking_nsxv3.common.synchronization [req-15788422-8e63-407f-9920-e43088f4393e req-cfd8460e-27f1-4ac5-9ff9-9d014b672c66 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 839.705632] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 839.705632] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.705632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.705632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.705632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.705632] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.705632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.705632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.707206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.707206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.707206] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.799861] env[65413]: INFO networking_nsxv3.common.synchronization [None req-7156733e-4d8e-45d3-9f1b-bd15a361fcee None None] Enqueued Resource ID: 6ea60b22-eb42-4efd-9e6c-cbddb40cdcfa with Priority: HIGHEST for action port [ 839.802046] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ea60b22-eb42-4efd-9e6c-cbddb40cdcfa with Priority: HIGHEST for action port [ 839.802046] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ea60b22-eb42-4efd-9e6c-cbddb40cdcfa taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.802046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ea60b22-eb42-4efd-9e6c-cbddb40cdcfa" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.802046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ea60b22-eb42-4efd-9e6c-cbddb40cdcfa" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.802046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ea60b22-eb42-4efd-9e6c-cbddb40cdcfa" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.802046] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ea60b22-eb42-4efd-9e6c-cbddb40cdcfa',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.874615] env[65413]: INFO networking_nsxv3.common.synchronization [None req-6f88209f-9489-4c79-9e73-1b6b1c86f37b None None] Enqueued Resource ID: 417f98a8-90eb-443a-86ef-071b705b83da with Priority: HIGHEST for action port [ 839.875263] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 417f98a8-90eb-443a-86ef-071b705b83da with Priority: HIGHEST for action port [ 839.875548] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-417f98a8-90eb-443a-86ef-071b705b83da taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.875673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-417f98a8-90eb-443a-86ef-071b705b83da" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.875748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-417f98a8-90eb-443a-86ef-071b705b83da" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.876014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-417f98a8-90eb-443a-86ef-071b705b83da" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.877812] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('417f98a8-90eb-443a-86ef-071b705b83da',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.219459] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.284251] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-187 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.284820] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.284820] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.284991] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.285308] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.285546] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.285922] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.285922] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.286124] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.287930] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.287930] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 840.287930] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 840.287930] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 840.287930] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 840.287930] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 840.287930] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 840.305154] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ea60b22-eb42-4efd-9e6c-cbddb40cdcfa [ 840.305154] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.305154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.305154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.305154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.305154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.305154] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ea60b22-eb42-4efd-9e6c-cbddb40cdcfa already deleted. [ 840.305154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ea60b22-eb42-4efd-9e6c-cbddb40cdcfa" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.309243] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 840.309243] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 840.309868] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 840.309868] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-187" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.310076] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.310255] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.310372] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.310773] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.310928] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aea91d42-16cf-40d3-af86-c9c9d0c1cd8e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.381029] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 417f98a8-90eb-443a-86ef-071b705b83da [ 840.381605] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.381605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.381605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.382454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.382454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.382454] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:417f98a8-90eb-443a-86ef-071b705b83da already deleted. [ 840.382454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-417f98a8-90eb-443a-86ef-071b705b83da" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.688171] env[65413]: INFO networking_nsxv3.common.synchronization [req-6bee78f4-eafe-404b-bfb0-8f197d2f6de0 req-21d843fc-cb99-4f48-bbf7-d9e4203dd4ee tempest-AttachInterfacesUnderV243Test-1674623919 tempest-AttachInterfacesUnderV243Test-1674623919-project-member] Enqueued Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_members [ 840.688371] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_members [ 840.688733] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.688857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.688903] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.689288] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.689453] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.689560] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.689621] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.689794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.689877] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.689974] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.717877] env[65413]: INFO networking_nsxv3.common.synchronization [req-6bee78f4-eafe-404b-bfb0-8f197d2f6de0 req-21d843fc-cb99-4f48-bbf7-d9e4203dd4ee tempest-AttachInterfacesUnderV243Test-1674623919 tempest-AttachInterfacesUnderV243Test-1674623919-project-member] Enqueued Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_rules [ 840.719212] env[65413]: INFO networking_nsxv3.common.synchronization [req-6bee78f4-eafe-404b-bfb0-8f197d2f6de0 req-21d843fc-cb99-4f48-bbf7-d9e4203dd4ee tempest-AttachInterfacesUnderV243Test-1674623919 tempest-AttachInterfacesUnderV243Test-1674623919-project-member] Enqueued Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_members [ 840.723020] env[65413]: INFO networking_nsxv3.common.synchronization [req-6bee78f4-eafe-404b-bfb0-8f197d2f6de0 req-21d843fc-cb99-4f48-bbf7-d9e4203dd4ee tempest-AttachInterfacesUnderV243Test-1674623919 tempest-AttachInterfacesUnderV243Test-1674623919-project-member] Enqueued Resource ID: 01617bc3-9032-4f9a-8e3e-db7fab34f17d with Priority: HIGHEST for action port [ 840.723020] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_rules [ 840.723020] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_members [ 840.723020] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01617bc3-9032-4f9a-8e3e-db7fab34f17d with Priority: HIGHEST for action port [ 840.723020] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.723020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.723020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.723020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.723020] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.723020] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.723020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.723020] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-01617bc3-9032-4f9a-8e3e-db7fab34f17d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.723020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.723869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.723869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.723869] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01617bc3-9032-4f9a-8e3e-db7fab34f17d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.724359] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.814707] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.815028] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.815163] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.815491] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.816126] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.816329] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port aea91d42-16cf-40d3-af86-c9c9d0c1cd8e not found, creating... [ 840.816628] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.816869] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.816986] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.817291] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.817455] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.817750] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.817933] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.818060] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.818284] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.818450] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.818693] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: aea91d42-16cf-40d3-af86-c9c9d0c1cd8e is going to be created. [ 840.846187] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.846488] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.846583] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.846895] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.847173] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.847422] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.192811] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.225737] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.225935] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.227573] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01617bc3-9032-4f9a-8e3e-db7fab34f17d with status ACTIVE [ 841.227882] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.227960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.228011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.228235] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.228342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.228575] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.228658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.228707] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.228865] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.229038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.229149] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.229264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.229335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.229549] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.229620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.229675] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01617bc3-9032-4f9a-8e3e-db7fab34f17d is going to be updated. [ 841.230888] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.231031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.231097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.231262] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.231338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.231426] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 841.265790] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.265790] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.265988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.266157] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.266282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.266484] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.277384] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.277605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.277747] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.277998] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.278436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.297173] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 841.620349] env[65413]: INFO networking_nsxv3.common.synchronization [req-15788422-8e63-407f-9920-e43088f4393e req-23fcc826-8df9-4c22-81a5-942cfaae54a9 service nova] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_rules [ 841.620847] env[65413]: INFO networking_nsxv3.common.synchronization [req-15788422-8e63-407f-9920-e43088f4393e req-23fcc826-8df9-4c22-81a5-942cfaae54a9 service nova] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 841.621129] env[65413]: INFO networking_nsxv3.common.synchronization [req-15788422-8e63-407f-9920-e43088f4393e req-23fcc826-8df9-4c22-81a5-942cfaae54a9 service nova] Enqueued Resource ID: aea91d42-16cf-40d3-af86-c9c9d0c1cd8e with Priority: HIGHEST for action port [ 841.621701] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_rules [ 841.621889] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 841.622060] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea91d42-16cf-40d3-af86-c9c9d0c1cd8e with Priority: HIGHEST for action port [ 841.622620] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.622620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.622620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.622874] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.622977] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.625183] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.625183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.625183] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.625183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.625420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.625577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.625674] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aea91d42-16cf-40d3-af86-c9c9d0c1cd8e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.697409] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.125573] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.126807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.132080] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aea91d42-16cf-40d3-af86-c9c9d0c1cd8e with status ACTIVE [ 842.132080] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.132080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.132080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.132331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.132331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.132399] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.132510] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.132551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.132752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.132854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.132957] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.133060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.133110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.133268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.133317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.133402] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aea91d42-16cf-40d3-af86-c9c9d0c1cd8e is going to be updated. [ 842.160310] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.160598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.160939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.161138] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.161235] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.161347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.204609] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.204609] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.205033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.205102] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.205203] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.205319] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b is going to be updated. [ 842.260802] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.260802] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.260802] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.261101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.261314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.290261] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: IN_PROGRESS for 2s [ 842.489358] env[65413]: INFO networking_nsxv3.common.synchronization [None req-dca6e329-8c9c-4452-bb91-f579257a4308 None None] Enqueued Resource ID: b676e48b-1d33-4b97-9c32-5e1dd191c948 with Priority: HIGHEST for action port [ 842.489358] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b676e48b-1d33-4b97-9c32-5e1dd191c948 with Priority: HIGHEST for action port [ 842.489358] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-b676e48b-1d33-4b97-9c32-5e1dd191c948 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.492218] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b676e48b-1d33-4b97-9c32-5e1dd191c948" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.492218] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b676e48b-1d33-4b97-9c32-5e1dd191c948" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.492218] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b676e48b-1d33-4b97-9c32-5e1dd191c948" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.492218] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b676e48b-1d33-4b97-9c32-5e1dd191c948',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.995732] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b676e48b-1d33-4b97-9c32-5e1dd191c948 [ 842.995732] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.995732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.995732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.995732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.995732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.995732] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b676e48b-1d33-4b97-9c32-5e1dd191c948 already deleted. [ 842.995732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b676e48b-1d33-4b97-9c32-5e1dd191c948" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.323165] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 843.323165] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.323794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.323794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.326378] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.326378] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.326378] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.326378] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.326378] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.326378] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.830658] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.301144] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: SUCCESS [ 844.303297] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.303297] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.303297] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.303297] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.303297] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.303297] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.303297] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.303297] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.303297] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.333759] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.804647] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.836565] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.836921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.836921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.837150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.837265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.837375] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 844.869878] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.870126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.870183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.870416] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.870623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.881682] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 845.307139] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.809311] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.809474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.809535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.809763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.809853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.809951] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b is going to be updated. [ 845.842085] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.842544] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.842544] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.842784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.842970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.855101] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: IN_PROGRESS for 2s [ 846.898180] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 846.898490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.898752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.899079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.900295] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.900295] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.900295] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.900295] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.900295] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.900295] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.901033] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.405125] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.406933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.406933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.406933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.406933] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.406933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.406933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.406933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.406933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.406933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.406933] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.409023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.409023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.409023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.409023] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.409023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.409023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.409023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.409023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.409023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.409023] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.489483] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 847.489646] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 847.703405] env[65413]: INFO networking_nsxv3.common.synchronization [None req-d39fad4d-5fd9-4a19-8aed-e77523572dd6 None None] Enqueued Resource ID: 28ba6d1a-6733-4a6b-9eef-db034940a5bc with Priority: HIGHEST for action port [ 847.703987] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28ba6d1a-6733-4a6b-9eef-db034940a5bc with Priority: HIGHEST for action port [ 847.704834] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-28ba6d1a-6733-4a6b-9eef-db034940a5bc taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.704834] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28ba6d1a-6733-4a6b-9eef-db034940a5bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.704834] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28ba6d1a-6733-4a6b-9eef-db034940a5bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.705166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28ba6d1a-6733-4a6b-9eef-db034940a5bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.705201] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28ba6d1a-6733-4a6b-9eef-db034940a5bc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.868504] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: SUCCESS [ 847.869176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.869372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.869597] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.869805] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.869927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.869992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.870163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.870232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.870313] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.870408] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.912347] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a6edb0e-97b9-43a5-ad22-81f0519d71f5: rpc.has_security_group_logging(os_id): False [ 847.937756] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.939331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.939331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.939331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.939331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.939770] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.939770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.940751] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.941020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.941144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.941400] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.941503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.941567] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.941788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.941842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.942048] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.942179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.942268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.942423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.942502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.942587] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 848.018357] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.018357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.018357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.018357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.018357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.045170] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 848.207614] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28ba6d1a-6733-4a6b-9eef-db034940a5bc [ 848.207884] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.208115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.208197] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.208416] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.208505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.208679] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28ba6d1a-6733-4a6b-9eef-db034940a5bc already deleted. [ 848.208679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28ba6d1a-6733-4a6b-9eef-db034940a5bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.377877] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.555942] env[65413]: INFO networking_nsxv3.common.synchronization [None req-752354ac-fa8e-42f4-92fd-c8e9fc97038d tempest-ServerActionsTestOtherA-276981019 tempest-ServerActionsTestOtherA-276981019-project-member] Enqueued Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_rules [ 848.555942] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_rules [ 848.556353] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba978295-db66-4f6f-800c-d69ad3fc5fec taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.556353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.556507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.557269] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.557269] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.877640] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c56a7ec-65f7-4b28-8303-747aa0500c3b: rpc.has_security_group_logging(os_id): False [ 848.899682] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.899682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.899682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.899682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.899682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.899682] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.899682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.899682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.900080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.900080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.900080] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b is going to be updated. [ 848.966062] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.966491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.966491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.966711] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.966860] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.981394] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: IN_PROGRESS for 2s [ 849.029399] env[65413]: INFO networking_nsxv3.common.synchronization [None req-30df8c14-9668-49e6-9e87-b748e2538a17 tempest-ServerActionsTestOtherA-276981019 tempest-ServerActionsTestOtherA-276981019-project-member] Enqueued Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_rules [ 849.030060] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_rules [ 849.030414] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba978295-db66-4f6f-800c-d69ad3fc5fec taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.030565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.093844] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.094087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.094264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.094536] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.094669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.094879] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba978295-db66-4f6f-800c-d69ad3fc5fec already deleted. [ 849.094939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.095385] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.095385] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.095385] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.617982] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.617982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.617982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.617982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.617982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.617982] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba978295-db66-4f6f-800c-d69ad3fc5fec already deleted. [ 849.617982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.064767] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 850.065210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.671741] env[65413]: INFO networking_nsxv3.common.synchronization [None req-c6d1980e-8f0a-433c-9c88-618baebe18df None None] Enqueued Resource ID: 023be35e-5b65-474e-9818-be99b8446426 with Priority: HIGHEST for action port [ 850.671741] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 023be35e-5b65-474e-9818-be99b8446426 with Priority: HIGHEST for action port [ 850.671741] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-023be35e-5b65-474e-9818-be99b8446426 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.671741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-023be35e-5b65-474e-9818-be99b8446426" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.672587] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-023be35e-5b65-474e-9818-be99b8446426" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.673313] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-023be35e-5b65-474e-9818-be99b8446426" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.673313] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('023be35e-5b65-474e-9818-be99b8446426',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.002190] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: SUCCESS [ 851.002820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.008068] env[65413]: INFO networking_nsxv3.common.synchronization [req-55241457-6c94-4501-a974-1b403e7c773a req-93be06d4-bc94-4337-a49b-5f2f401b25b5 tempest-AttachInterfacesUnderV243Test-1674623919 tempest-AttachInterfacesUnderV243Test-1674623919-project-member] Enqueued Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_members [ 851.008068] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_members [ 851.008068] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.008068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.008068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.008068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.008706] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.010064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.010064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.010064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.010064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.010064] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.034032] env[65413]: INFO networking_nsxv3.common.synchronization [req-55241457-6c94-4501-a974-1b403e7c773a req-93be06d4-bc94-4337-a49b-5f2f401b25b5 tempest-AttachInterfacesUnderV243Test-1674623919 tempest-AttachInterfacesUnderV243Test-1674623919-project-member] Enqueued Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_rules [ 851.034032] env[65413]: INFO networking_nsxv3.common.synchronization [req-55241457-6c94-4501-a974-1b403e7c773a req-93be06d4-bc94-4337-a49b-5f2f401b25b5 tempest-AttachInterfacesUnderV243Test-1674623919 tempest-AttachInterfacesUnderV243Test-1674623919-project-member] Enqueued Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_members [ 851.034032] env[65413]: INFO networking_nsxv3.common.synchronization [req-55241457-6c94-4501-a974-1b403e7c773a req-93be06d4-bc94-4337-a49b-5f2f401b25b5 tempest-AttachInterfacesUnderV243Test-1674623919 tempest-AttachInterfacesUnderV243Test-1674623919-project-member] Enqueued Resource ID: 01617bc3-9032-4f9a-8e3e-db7fab34f17d with Priority: HIGHEST for action port [ 851.034032] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_rules [ 851.034032] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_members [ 851.034032] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01617bc3-9032-4f9a-8e3e-db7fab34f17d with Priority: HIGHEST for action port [ 851.034032] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.034032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.034032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.034032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.034032] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.035597] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.036086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.036885] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-01617bc3-9032-4f9a-8e3e-db7fab34f17d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.037683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.037895] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.040269] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.040269] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01617bc3-9032-4f9a-8e3e-db7fab34f17d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.176500] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 023be35e-5b65-474e-9818-be99b8446426 [ 851.178648] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.178648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.178648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.178648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.178648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.178648] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:023be35e-5b65-474e-9818-be99b8446426 already deleted. [ 851.178648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-023be35e-5b65-474e-9818-be99b8446426" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.512532] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.540589] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.540589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.542855] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01617bc3-9032-4f9a-8e3e-db7fab34f17d with status ACTIVE [ 851.543202] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.543365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.543443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.543656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.543744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.543927] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.544276] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.544374] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.544543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.544623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.544816] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.544988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.545064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.545204] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.545292] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.545361] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01617bc3-9032-4f9a-8e3e-db7fab34f17d is going to be updated. [ 851.571523] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.571523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.571523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.571523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.571523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.571915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01617bc3-9032-4f9a-8e3e-db7fab34f17d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.017037] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.518766] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.519109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.519109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.519244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.519333] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.519430] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b is going to be updated. [ 852.556701] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.556963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.556963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.557255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.557430] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.586352] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: IN_PROGRESS for 2s [ 853.297019] env[65413]: INFO networking_nsxv3.common.synchronization [req-78b84f9c-aa7d-4609-8fab-13a07fe33fb3 req-a84c557c-e474-4e39-9e9f-fde19242e388 tempest-MigrationsAdminTest-1569866777 tempest-MigrationsAdminTest-1569866777-project-member] Enqueued Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_members [ 853.297019] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_members [ 853.297019] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.297019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.297019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.297019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.297588] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.297846] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.298060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.299160] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.299160] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.299160] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.611891] env[65413]: INFO networking_nsxv3.common.synchronization [req-62b4fd53-8ae2-4ed6-85cc-c302618879e5 req-7bbcb4e4-6df6-4f88-b021-7608a9fe071b tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 853.612474] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 853.612782] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.612902] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.612966] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.614173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.614394] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.614507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.614567] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.614735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.614844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.614945] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.800987] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.982766] env[65413]: INFO networking_nsxv3.common.synchronization [None req-f6b0baaa-db12-48b6-b814-622bfea42c06 None None] Enqueued Resource ID: 34a6901d-c082-414d-b818-3fc4aa27b497 with Priority: HIGHEST for action port [ 853.983225] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a6901d-c082-414d-b818-3fc4aa27b497 with Priority: HIGHEST for action port [ 853.984457] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-34a6901d-c082-414d-b818-3fc4aa27b497 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.984688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-34a6901d-c082-414d-b818-3fc4aa27b497" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.984872] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-34a6901d-c082-414d-b818-3fc4aa27b497" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.985212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-34a6901d-c082-414d-b818-3fc4aa27b497" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.985623] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('34a6901d-c082-414d-b818-3fc4aa27b497',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.118579] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.118579] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.118579] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.118579] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.118579] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.118996] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.118996] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.118996] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.119136] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.119182] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.119264] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 already deleted. [ 854.119681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.304501] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.362024] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.362024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.362024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.362024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.362024] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.362024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.362024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.362024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.362669] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.363028] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.363720] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 854.364338] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 854.364669] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 854.364918] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 854.365195] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 854.366257] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 854.386925] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 854.387466] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 854.387466] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 854.387466] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.387715] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-dca5c1c9-18e4-4ddf-ae67-450f9a7628ba taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.387935] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-dca5c1c9-18e4-4ddf-ae67-450f9a7628ba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.388707] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-dca5c1c9-18e4-4ddf-ae67-450f9a7628ba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.388707] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-dca5c1c9-18e4-4ddf-ae67-450f9a7628ba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.388904] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dca5c1c9-18e4-4ddf-ae67-450f9a7628ba',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.487363] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 34a6901d-c082-414d-b818-3fc4aa27b497 [ 854.488668] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.489389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.489389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.489389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.489540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.489587] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:34a6901d-c082-414d-b818-3fc4aa27b497 already deleted. [ 854.489806] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-34a6901d-c082-414d-b818-3fc4aa27b497" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.599023] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: SUCCESS [ 854.599256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.599423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.599644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.599834] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.599981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.600038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.600177] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.600253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.600344] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.719095] env[65413]: INFO networking_nsxv3.common.synchronization [req-1a2f73e8-bbcf-4676-bc08-deb9c5f870c9 req-bc6e2bea-44b0-4cd0-b2d5-20a23a42de1b tempest-ServersWithSpecificFlavorTestJSON-163220255 tempest-ServersWithSpecificFlavorTestJSON-163220255-project-member] Enqueued Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_members [ 854.720521] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 with Priority: HIGHEST for action security_group_members [ 854.721291] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.723283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.723283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.723283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.723283] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.723283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.723283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.723283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.723283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.723283] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.809611] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.809824] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.809824] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.810019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.810121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.810215] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af248d88-efaa-44cd-99ca-972413455b63 is going to be updated. [ 854.844028] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.844028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.844028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.844028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.844028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.855585] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: IN_PROGRESS for 2s [ 854.892788] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.893144] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.893367] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.893772] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.894038] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.894319] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port dca5c1c9-18e4-4ddf-ae67-450f9a7628ba not found, creating... [ 854.894748] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.894748] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.894884] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.895144] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.895306] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.895608] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.895778] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.895895] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.897381] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.897381] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.897381] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: dca5c1c9-18e4-4ddf-ae67-450f9a7628ba is going to be created. [ 854.919927] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.920155] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.920271] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.920553] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.920767] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.921106] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-dca5c1c9-18e4-4ddf-ae67-450f9a7628ba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.033763] env[65413]: INFO networking_nsxv3.common.synchronization [None req-34b7e412-af30-4523-98f3-64aa6a6652aa None None] Enqueued Resource ID: 4c47f79d-cd84-4f3b-b148-009444a24e86 with Priority: HIGHEST for action port [ 855.034397] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c47f79d-cd84-4f3b-b148-009444a24e86 with Priority: HIGHEST for action port [ 855.034727] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c47f79d-cd84-4f3b-b148-009444a24e86 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.034849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c47f79d-cd84-4f3b-b148-009444a24e86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.034911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c47f79d-cd84-4f3b-b148-009444a24e86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.035545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c47f79d-cd84-4f3b-b148-009444a24e86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.035545] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c47f79d-cd84-4f3b-b148-009444a24e86',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.102305] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.225888] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.226075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.226152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.226420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.248995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.249254] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.249357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.249401] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.249771] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.249771] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.249771] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 is going to be updated. [ 855.295892] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.296149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.296271] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.296599] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.296942] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.307299] env[65413]: INFO networking_nsxv3.common.synchronization [req-d242bbfe-2b8d-4c62-b341-9c9fc065a480 req-e4d1cbee-0efd-46d0-b434-f383d9819408 tempest-ImagesTestJSON-1309992501 tempest-ImagesTestJSON-1309992501-project-member] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 855.307873] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 855.308257] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.308378] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.308443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.308750] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.308853] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.308963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.308999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.309180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.309259] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.309686] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.311164] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 in Status: IN_PROGRESS for 2s [ 855.537847] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c47f79d-cd84-4f3b-b148-009444a24e86 [ 855.537847] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.537955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.538067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.538294] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.538382] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.538486] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c47f79d-cd84-4f3b-b148-009444a24e86 already deleted. [ 855.538565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c47f79d-cd84-4f3b-b148-009444a24e86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.608532] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.634423] env[65413]: INFO networking_nsxv3.common.synchronization [req-62b4fd53-8ae2-4ed6-85cc-c302618879e5 req-bc356c56-fd2e-4d69-872d-0e0fcf2748ff service nova] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_rules [ 855.634586] env[65413]: INFO networking_nsxv3.common.synchronization [req-62b4fd53-8ae2-4ed6-85cc-c302618879e5 req-bc356c56-fd2e-4d69-872d-0e0fcf2748ff service nova] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 855.634714] env[65413]: INFO networking_nsxv3.common.synchronization [req-62b4fd53-8ae2-4ed6-85cc-c302618879e5 req-bc356c56-fd2e-4d69-872d-0e0fcf2748ff service nova] Enqueued Resource ID: dca5c1c9-18e4-4ddf-ae67-450f9a7628ba with Priority: HIGHEST for action port [ 855.635264] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_rules [ 855.639023] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 855.639246] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dca5c1c9-18e4-4ddf-ae67-450f9a7628ba with Priority: HIGHEST for action port [ 855.639574] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.640557] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.640557] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.640557] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.640557] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.642748] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.642748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.642748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.642748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.642748] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.642748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.642748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.642748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.642748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.642748] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.643351] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-dca5c1c9-18e4-4ddf-ae67-450f9a7628ba taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.643351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dca5c1c9-18e4-4ddf-ae67-450f9a7628ba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.644352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dca5c1c9-18e4-4ddf-ae67-450f9a7628ba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.644352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dca5c1c9-18e4-4ddf-ae67-450f9a7628ba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.645051] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dca5c1c9-18e4-4ddf-ae67-450f9a7628ba',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.812865] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.816920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.816920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.816920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.816920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.816920] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.816920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.816920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.816920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.816920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.816920] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 855.844894] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.844894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.844894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.844894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.845277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.855377] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 856.109990] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.110413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.110413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.110593] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.110593] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.111446] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b is going to be updated. [ 856.146211] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.146211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.146211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.146211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.146211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.146952] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.148829] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.149290] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.150521] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dca5c1c9-18e4-4ddf-ae67-450f9a7628ba with status ACTIVE [ 856.150627] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.150863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.151058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.151339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.152017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.152017] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.152017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.152017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.152551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.154701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.154701] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.154701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.154701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.154701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.154701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.154701] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dca5c1c9-18e4-4ddf-ae67-450f9a7628ba is going to be updated. [ 856.165062] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: IN_PROGRESS for 2s [ 856.200104] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.200104] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.200104] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.200343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.200646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.200646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dca5c1c9-18e4-4ddf-ae67-450f9a7628ba" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.531299] env[65413]: INFO networking_nsxv3.common.synchronization [req-4ec41e6c-976a-46b0-99a7-183edb600ac1 req-db950929-ff69-4ceb-9c89-c1356bfcfeab tempest-ServerRescueNegativeTestJSON-135341842 tempest-ServerRescueNegativeTestJSON-135341842-project-member] Enqueued Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_members [ 856.532388] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_members [ 856.532388] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.532388] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.532388] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.532622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.532792] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.532891] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.532945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.533792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.533860] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.533949] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.650014] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.872137] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: SUCCESS [ 856.872137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.916029] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.916795] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-603" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.916951] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-603" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.918034] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-603" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.918339] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.918530] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.918688] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.918973] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.919087] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.919296] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.919401] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.919503] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.919607] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.919714] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.919817] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.919947] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.939124] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.939306] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 856.939445] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.939621] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-603" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.939938] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-874438f9-4007-44a0-95a5-aea2d8c53578 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.940206] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-874438f9-4007-44a0-95a5-aea2d8c53578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.940333] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-874438f9-4007-44a0-95a5-aea2d8c53578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.940647] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-874438f9-4007-44a0-95a5-aea2d8c53578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.940785] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('874438f9-4007-44a0-95a5-aea2d8c53578',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.973352] env[65413]: INFO networking_nsxv3.common.synchronization [None req-ba490c9c-bd2c-479f-b24f-9c751827b3fa None None] Enqueued Resource ID: 90270519-b73d-4cd9-ac52-aa7fc1e12a20 with Priority: HIGHEST for action port [ 856.973352] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90270519-b73d-4cd9-ac52-aa7fc1e12a20 with Priority: HIGHEST for action port [ 856.973352] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-90270519-b73d-4cd9-ac52-aa7fc1e12a20 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.973352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90270519-b73d-4cd9-ac52-aa7fc1e12a20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.973352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90270519-b73d-4cd9-ac52-aa7fc1e12a20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.973352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90270519-b73d-4cd9-ac52-aa7fc1e12a20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.973352] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90270519-b73d-4cd9-ac52-aa7fc1e12a20',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.039011] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.039011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.039011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.041195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.041195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.041195] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.041195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.041195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.041195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.041195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.041195] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c249e605-e5e9-4e19-9316-502e4084ec60 already deleted. [ 857.041719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.153143] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.153143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.153143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.153143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.153143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.153143] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be created. [ 857.179037] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.179037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.179037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.179037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.179037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.187795] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: UNINITIALIZED for 2s [ 857.323604] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 in Status: SUCCESS [ 857.324879] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100 deletion is rescheduled due to dependency. [ 857.324879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.342590] env[65413]: INFO networking_nsxv3.common.synchronization [None req-e07f3df0-81d9-4cd9-aa77-93a8d95aedf4 None None] Enqueued Resource ID: c25f31e8-df08-47e9-804b-bbaf5af7204d with Priority: HIGHEST for action port [ 857.343089] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c25f31e8-df08-47e9-804b-bbaf5af7204d with Priority: HIGHEST for action port [ 857.343444] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-c25f31e8-df08-47e9-804b-bbaf5af7204d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.343594] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c25f31e8-df08-47e9-804b-bbaf5af7204d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.343656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c25f31e8-df08-47e9-804b-bbaf5af7204d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.343910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c25f31e8-df08-47e9-804b-bbaf5af7204d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.343989] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c25f31e8-df08-47e9-804b-bbaf5af7204d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.443437] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.443668] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.443793] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.444102] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.444484] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.444484] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 874438f9-4007-44a0-95a5-aea2d8c53578 not found, creating... [ 857.444658] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.444818] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.444935] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.445186] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.445312] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.445587] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.445741] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.445857] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.447687] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.447687] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.447687] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 874438f9-4007-44a0-95a5-aea2d8c53578 is going to be created. [ 857.470037] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.470229] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.470275] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.470528] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.470750] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.471062] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-874438f9-4007-44a0-95a5-aea2d8c53578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.476278] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 90270519-b73d-4cd9-ac52-aa7fc1e12a20 [ 857.476278] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.476278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.476278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.476278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.476561] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.476561] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:90270519-b73d-4cd9-ac52-aa7fc1e12a20 already deleted. [ 857.476561] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90270519-b73d-4cd9-ac52-aa7fc1e12a20" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.846954] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c25f31e8-df08-47e9-804b-bbaf5af7204d [ 857.846954] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.847230] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.847230] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.847312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.847365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.847462] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c25f31e8-df08-47e9-804b-bbaf5af7204d already deleted. [ 857.847545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c25f31e8-df08-47e9-804b-bbaf5af7204d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.864858] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 857.864858] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 deletion is rescheduled due to dependency. [ 857.865034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.177423] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: SUCCESS [ 858.177423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.177423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.177423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.177423] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.177423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.177423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.177423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.177423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.177423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.177423] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.207550] env[65413]: INFO networking_nsxv3.common.synchronization [req-4ec41e6c-976a-46b0-99a7-183edb600ac1 req-6d20e671-ad0f-4ff4-a68f-1a7a8f03148e service nova] Enqueued Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_rules [ 858.207730] env[65413]: INFO networking_nsxv3.common.synchronization [req-4ec41e6c-976a-46b0-99a7-183edb600ac1 req-6d20e671-ad0f-4ff4-a68f-1a7a8f03148e service nova] Enqueued Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_members [ 858.207867] env[65413]: INFO networking_nsxv3.common.synchronization [req-4ec41e6c-976a-46b0-99a7-183edb600ac1 req-6d20e671-ad0f-4ff4-a68f-1a7a8f03148e service nova] Enqueued Resource ID: 874438f9-4007-44a0-95a5-aea2d8c53578 with Priority: HIGHEST for action port [ 858.208640] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_rules [ 858.208784] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_members [ 858.208952] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 874438f9-4007-44a0-95a5-aea2d8c53578 with Priority: HIGHEST for action port [ 858.209286] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.209409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.209471] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.209737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.209843] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.211045] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.211167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.211234] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.211420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.211563] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.211656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.211715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.211873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.211941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.212029] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.212759] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-874438f9-4007-44a0-95a5-aea2d8c53578 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.212864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-874438f9-4007-44a0-95a5-aea2d8c53578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.212930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-874438f9-4007-44a0-95a5-aea2d8c53578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.213124] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-874438f9-4007-44a0-95a5-aea2d8c53578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.213221] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('874438f9-4007-44a0-95a5-aea2d8c53578',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.385828] env[65413]: INFO networking_nsxv3.common.synchronization [req-fc85f52c-4f8c-4c9c-8f6c-dae4aa849d67 req-e0b96c80-ca38-48e8-ba23-ed456954d825 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 858.386008] env[65413]: INFO networking_nsxv3.common.synchronization [req-fc85f52c-4f8c-4c9c-8f6c-dae4aa849d67 req-e0b96c80-ca38-48e8-ba23-ed456954d825 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGHEST for action security_group_members [ 858.386626] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 858.386758] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGHEST for action security_group_members [ 858.387573] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.387741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.387840] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.388095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.388289] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.388426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.388517] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.388726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.388873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.389013] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.389910] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbfb80ba-80ff-4142-b496-98bf89fbe02f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.390074] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.390170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.390419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.390605] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.390736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.390826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.391107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.391225] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.391344] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.432703] env[65413]: INFO networking_nsxv3.common.synchronization [req-fc85f52c-4f8c-4c9c-8f6c-dae4aa849d67 req-e0b96c80-ca38-48e8-ba23-ed456954d825 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_rules [ 858.432949] env[65413]: INFO networking_nsxv3.common.synchronization [req-fc85f52c-4f8c-4c9c-8f6c-dae4aa849d67 req-e0b96c80-ca38-48e8-ba23-ed456954d825 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 858.433138] env[65413]: INFO networking_nsxv3.common.synchronization [req-fc85f52c-4f8c-4c9c-8f6c-dae4aa849d67 req-e0b96c80-ca38-48e8-ba23-ed456954d825 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGHEST for action security_group_rules [ 858.433276] env[65413]: INFO networking_nsxv3.common.synchronization [req-fc85f52c-4f8c-4c9c-8f6c-dae4aa849d67 req-e0b96c80-ca38-48e8-ba23-ed456954d825 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGHEST for action security_group_members [ 858.433402] env[65413]: INFO networking_nsxv3.common.synchronization [req-fc85f52c-4f8c-4c9c-8f6c-dae4aa849d67 req-e0b96c80-ca38-48e8-ba23-ed456954d825 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: aea91d42-16cf-40d3-af86-c9c9d0c1cd8e with Priority: HIGHEST for action port [ 858.434186] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_rules [ 858.434361] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGHEST for action security_group_rules [ 858.434548] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea91d42-16cf-40d3-af86-c9c9d0c1cd8e with Priority: HIGHEST for action port [ 858.434712] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 858.434886] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGHEST for action security_group_members [ 858.435256] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.435472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.435602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.435881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.436038] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.437452] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbfb80ba-80ff-4142-b496-98bf89fbe02f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.437624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.437737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.438094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.438281] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.439301] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.439797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.439797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.440237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.441043] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aea91d42-16cf-40d3-af86-c9c9d0c1cd8e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.441978] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.441978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.441978] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbfb80ba-80ff-4142-b496-98bf89fbe02f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.442395] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.679736] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.691809] env[65413]: INFO networking_nsxv3.common.synchronization [req-37a1ce90-376e-4a21-8860-fec64cecf927 req-22cec996-256c-4581-af58-7a19a51f82bc tempest-ImagesOneServerNegativeTestJSON-1663656844 tempest-ImagesOneServerNegativeTestJSON-1663656844-project-member] Enqueued Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 858.692546] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 858.693126] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.693126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.693126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.693319] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.693412] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.693514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.693581] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.693738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.693819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.694139] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.714839] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.715062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.715360] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.717310] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 874438f9-4007-44a0-95a5-aea2d8c53578 with status ACTIVE [ 858.717310] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.717310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.717310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.717310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.717854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.717854] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.717854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.717984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.718690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.719886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.719886] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.719886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.720132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.720794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.720945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.721112] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 874438f9-4007-44a0-95a5-aea2d8c53578 is going to be updated. [ 858.751913] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.752992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.752992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.752992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.753718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.753718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-874438f9-4007-44a0-95a5-aea2d8c53578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.893667] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.894980] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.944956] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aea91d42-16cf-40d3-af86-c9c9d0c1cd8e with status ACTIVE [ 858.944956] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.944956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.944956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.944956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.944956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.945375] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.945375] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.945375] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.945375] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.945632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.945632] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.945734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.945734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.945882] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.945945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.946036] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aea91d42-16cf-40d3-af86-c9c9d0c1cd8e is going to be updated. [ 858.948025] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.948025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.948025] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbfb80ba-80ff-4142-b496-98bf89fbe02f taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.948025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.970249] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.970452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.970452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.970660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.970798] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.972436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.132414] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-327 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.132607] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-327" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.132732] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-327" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.133549] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-327" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.133830] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.133985] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.134111] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.134341] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.134479] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.134677] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 859.134781] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 859.134882] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 859.134997] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 859.135107] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 859.135211] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 859.135342] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 859.156682] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 859.156892] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 859.157198] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 859.157198] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-327" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.157627] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-d092a646-514d-4559-a112-3afa6c37a881 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.157859] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-d092a646-514d-4559-a112-3afa6c37a881" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.158123] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-d092a646-514d-4559-a112-3afa6c37a881" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.158609] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-d092a646-514d-4559-a112-3afa6c37a881" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.158609] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d092a646-514d-4559-a112-3afa6c37a881',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.182246] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9c56a7ec-65f7-4b28-8303-747aa0500c3b: rpc.has_security_group_logging(os_id): False [ 859.196053] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.196292] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.196393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.196669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.198706] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 859.198899] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.199257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.199487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.199729] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.199880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.199949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.200135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.200249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.200343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.200434] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.203073] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.203073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.223942] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.231106] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.232027] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.232027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.232027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.232027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.232027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.232290] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 is going to be updated. [ 859.233866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.235019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.235019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.235019] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.235019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.235019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.235019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.235296] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.235296] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b is going to be updated. [ 859.263351] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.263645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.263645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.263778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.263921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.273628] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: IN_PROGRESS for 2s [ 859.307577] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.307726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.307792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.308024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.308165] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.327123] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: IN_PROGRESS for 2s [ 859.400907] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.400907] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.660913] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.661260] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.661434] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.661822] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.661908] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.662062] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port d092a646-514d-4559-a112-3afa6c37a881 not found, creating... [ 859.662377] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.662565] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.662842] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.662936] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.663107] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.663435] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.663627] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.663739] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.663955] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.664133] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.664296] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: d092a646-514d-4559-a112-3afa6c37a881 is going to be created. [ 859.687105] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.687351] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.687438] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.687723] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.687944] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.688178] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-d092a646-514d-4559-a112-3afa6c37a881" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.704655] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.705766] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.705919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.706158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.706336] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.706458] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.706543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.706677] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.706764] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.706852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.707140] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.707140] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.707279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.707347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.707487] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.707580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.707639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.707770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.707970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.707970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.708085] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.725891] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.726090] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.726219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.726419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.726607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.726796] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c249e605-e5e9-4e19-9316-502e4084ec60 is going to be created. [ 859.751265] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.751464] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.751464] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.751669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.751861] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.765145] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: UNINITIALIZED for 2s [ 859.903592] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.903794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.903869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.904098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.904284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.904565] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f is going to be created. [ 859.905978] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.906126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.906194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.906379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.906476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.906582] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 859.937479] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.937479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.937479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.937479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.937479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.945927] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.946139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.946139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.946452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.946601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.949520] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f in Status: UNINITIALIZED for 2s [ 859.954903] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 860.210172] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abda67a6-20b2-4d8b-8a37-701a11fb0d75: rpc.has_security_group_logging(os_id): False [ 860.230095] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.230277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.230342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.230577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.230667] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.231017] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.231470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.231603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.231729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.231809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.232075] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.232184] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.232247] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.232893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.233116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.233230] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.233323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.233398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.233551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.233624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.233708] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be created. [ 860.307792] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.307792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.307792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.307792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.308217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.340904] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 860.410914] env[65413]: INFO networking_nsxv3.common.synchronization [req-37a1ce90-376e-4a21-8860-fec64cecf927 req-ce1e087f-7021-4945-bfef-7c49208b57e5 service nova] Enqueued Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_rules [ 860.411156] env[65413]: INFO networking_nsxv3.common.synchronization [req-37a1ce90-376e-4a21-8860-fec64cecf927 req-ce1e087f-7021-4945-bfef-7c49208b57e5 service nova] Enqueued Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 860.411372] env[65413]: INFO networking_nsxv3.common.synchronization [req-37a1ce90-376e-4a21-8860-fec64cecf927 req-ce1e087f-7021-4945-bfef-7c49208b57e5 service nova] Enqueued Resource ID: d092a646-514d-4559-a112-3afa6c37a881 with Priority: HIGHEST for action port [ 860.411892] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_rules [ 860.412467] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 860.412620] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d092a646-514d-4559-a112-3afa6c37a881 with Priority: HIGHEST for action port [ 860.412909] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.413045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.413114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.413318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.413400] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.415657] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.415657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.415657] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-d092a646-514d-4559-a112-3afa6c37a881 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.415657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d092a646-514d-4559-a112-3afa6c37a881" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.415951] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d092a646-514d-4559-a112-3afa6c37a881" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.415951] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d092a646-514d-4559-a112-3afa6c37a881" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.415951] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d092a646-514d-4559-a112-3afa6c37a881',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.918657] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.918657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.920118] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d092a646-514d-4559-a112-3afa6c37a881 with status ACTIVE [ 860.920118] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.920118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.920118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.920118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.920118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.920118] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.920118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.920118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.920620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.920620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.920620] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.920732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.920732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.920960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.922469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.922628] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d092a646-514d-4559-a112-3afa6c37a881 is going to be updated. [ 860.954687] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.954948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.954948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.955323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.955323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.955501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d092a646-514d-4559-a112-3afa6c37a881" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.274751] env[65413]: INFO networking_nsxv3.common.synchronization [req-9e89f075-2a7c-4aec-ac6e-b8b39810ef63 req-228a49e6-f74d-43b7-8e53-4e37f7ed9885 tempest-AttachInterfacesUnderV243Test-1674623919 tempest-AttachInterfacesUnderV243Test-1674623919-project-member] Enqueued Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_members [ 861.276168] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGHEST for action security_group_members [ 861.276741] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.276870] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.276870] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.277035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.277191] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.277339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.277415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.277843] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.277843] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.277843] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.290210] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: SUCCESS [ 861.290382] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 deletion is rescheduled due to dependency. [ 861.290503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.290729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.290840] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.291110] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.291240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.291323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.292391] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.292391] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.292391] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.348451] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: SUCCESS [ 861.348757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.766836] env[65413]: INFO networking_nsxv3.common.synchronization [req-155bb0ea-88a4-4fe7-8b48-6199f863bbc0 req-50420b70-26b4-4382-8ce5-f99d600a1deb tempest-ServerRescueNegativeTestJSON-135341842 tempest-ServerRescueNegativeTestJSON-135341842-project-member] Enqueued Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_members [ 861.768165] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_members [ 861.768708] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.768836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.779523] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: SUCCESS [ 861.779523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.779523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.780266] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.780521] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.780729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.780791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.781070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.781210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.781337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.781617] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.784064] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.784227] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.784323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.784524] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.784611] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.784934] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.785099] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.785152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.785557] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.785557] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.785557] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b is going to be updated. [ 861.786350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.786516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.786705] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.786980] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.789465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.789465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.789465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.789465] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.794086] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.820042] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.820042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.820042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.820042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.820042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.832182] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: IN_PROGRESS for 2s [ 861.963453] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f in Status: SUCCESS [ 861.964309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.964309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.979858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.979858] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.979858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.979858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.979858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.979858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.979858] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.979858] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 861.979858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.979858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.979858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.979858] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.979858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.979858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.979858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.979858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.979858] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.190030] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.190272] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-603" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.190490] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-603" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.190721] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-603" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.191241] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.191541] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.191716] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.192273] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.192334] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.192583] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.192752] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 862.193128] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 862.193128] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 862.193243] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 862.193405] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 862.193575] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 862.213950] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 862.214142] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 862.214276] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 862.214445] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-603" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.214760] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.215190] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.215190] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.215440] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.215580] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.291411] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.291752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.293033] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.296865] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.357096] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 862.357096] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.471583] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.473539] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.718253] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.718253] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.718510] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.718862] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.719088] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.719291] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd not found, creating... [ 862.719594] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.719804] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.719950] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.720223] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.720408] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.720727] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.720998] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.721176] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.721637] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.721819] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.722015] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd is going to be created. [ 862.746092] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.746328] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.746453] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.746737] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.746968] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.747199] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.795585] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.800059] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.800675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.800675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.800852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.801134] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.801283] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 is going to be updated. [ 862.846180] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.846407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.846407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.846577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.846680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.859356] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: IN_PROGRESS for 2s [ 862.976841] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.976841] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.298385] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.299434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.299583] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.299928] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.300089] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.300271] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c249e605-e5e9-4e19-9316-502e4084ec60 is going to be updated. [ 863.353945] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.354164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.354215] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.354397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.354536] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.363881] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: IN_PROGRESS for 2s [ 863.477636] env[65413]: INFO networking_nsxv3.common.synchronization [req-155bb0ea-88a4-4fe7-8b48-6199f863bbc0 req-37a95ff2-c197-4d38-938c-7e54fbc5712c service nova] Enqueued Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_rules [ 863.477924] env[65413]: INFO networking_nsxv3.common.synchronization [req-155bb0ea-88a4-4fe7-8b48-6199f863bbc0 req-37a95ff2-c197-4d38-938c-7e54fbc5712c service nova] Enqueued Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_members [ 863.480105] env[65413]: INFO networking_nsxv3.common.synchronization [req-155bb0ea-88a4-4fe7-8b48-6199f863bbc0 req-37a95ff2-c197-4d38-938c-7e54fbc5712c service nova] Enqueued Resource ID: 0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd with Priority: HIGHEST for action port [ 863.480105] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.480105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.480105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.480105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.480105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.480105] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 863.480591] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.480669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.480872] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.480957] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.481062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.481830] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f is going to be updated. [ 863.482137] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_rules [ 863.482217] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_members [ 863.482310] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd with Priority: HIGHEST for action port [ 863.483149] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.483149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.483316] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.483316] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.486102] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.486102] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.486102] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.486102] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.486102] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.518289] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.518469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.518536] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.518726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.518851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.521392] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.521798] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.521798] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.521964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.522695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.536054] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f in Status: IN_PROGRESS for 2s [ 863.536819] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 863.842469] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b in Status: SUCCESS [ 863.842672] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b deletion is rescheduled due to dependency. [ 863.842748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.986653] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd with status ACTIVE [ 863.987018] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.987436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.987436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.987436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.987436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.987585] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.987784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.987784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.987873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.988055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.991183] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.991183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.991183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.991183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.991183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.991183] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd is going to be updated. [ 864.017989] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.018320] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.018400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.018622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.018753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.018939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e9a5eb3-3462-4253-b5d8-48ba4a4f2dbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.869402] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: SUCCESS [ 864.869734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.869734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.869966] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.870278] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.870638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.870638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.870795] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.871595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.872328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.872471] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.008016] env[65413]: INFO networking_nsxv3.common.synchronization [None req-42701490-1c56-4f67-9c90-ce955aca5cd1 None None] Enqueued Resource ID: 60125dda-de91-4ad0-a99d-a5861e4af6fd with Priority: HIGHEST for action port [ 865.008016] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60125dda-de91-4ad0-a99d-a5861e4af6fd with Priority: HIGHEST for action port [ 865.008320] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-60125dda-de91-4ad0-a99d-a5861e4af6fd taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.008437] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-60125dda-de91-4ad0-a99d-a5861e4af6fd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.008496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-60125dda-de91-4ad0-a99d-a5861e4af6fd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.008748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-60125dda-de91-4ad0-a99d-a5861e4af6fd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.008823] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('60125dda-de91-4ad0-a99d-a5861e4af6fd',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.375794] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: SUCCESS [ 865.376031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.376396] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.376517] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.376582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.376788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.376953] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.377301] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.377301] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.377301] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.377460] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.377494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.377650] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.377741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.377802] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.377990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.378095] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.378186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.378241] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.378381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.378454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.378531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.378619] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.379507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.379672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.379824] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.379923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.379988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.380148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.380233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.380298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.380451] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.380528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.380586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.380722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.380868] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.380983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.381055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.381196] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.381267] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.381344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.381423] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.382493] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.383847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.383847] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.383847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.383847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.383847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.383847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.385185] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.512409] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 60125dda-de91-4ad0-a99d-a5861e4af6fd [ 865.512409] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.512409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.512409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.512409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.512409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.512663] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:60125dda-de91-4ad0-a99d-a5861e4af6fd already deleted. [ 865.512663] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-60125dda-de91-4ad0-a99d-a5861e4af6fd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.548317] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f in Status: SUCCESS [ 865.548576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.548775] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.549132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.549390] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.549744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.549744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.549744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.549942] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.549942] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.550022] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.551549] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 865.551723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.551920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.552132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.552336] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.552458] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.552580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.552708] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.552802] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.552890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.552988] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.883237] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3d036f63-388f-4a40-b3dc-855ae378cbe3: rpc.has_security_group_logging(os_id): False [ 865.888851] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c249e605-e5e9-4e19-9316-502e4084ec60: rpc.has_security_group_logging(os_id): False [ 865.889334] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.913543] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.913821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.913879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.914202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.914334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.914533] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.914625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.914689] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.914849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.914955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.915189] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.915310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.915387] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.916605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.916605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.916605] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.916605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.916605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.916605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.916605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.916605] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c249e605-e5e9-4e19-9316-502e4084ec60 is going to be created. [ 865.917962] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.918091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.918316] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.918501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.921849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.921849] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.921849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.921849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.921849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.921849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.921849] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.921849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.921849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.921849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.921849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.921849] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.921849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.921849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.922497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.922497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.922497] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 is going to be updated. [ 865.997788] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.998033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.998564] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.998564] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.998760] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.033474] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: IN_PROGRESS for 2s [ 866.035097] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.035366] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.035505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.035872] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.039100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.055313] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.057098] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.057383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.057490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.058838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.058838] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.058838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.059014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.059719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.059719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.059719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.059871] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.059985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.060110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.064404] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.064404] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.064404] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.064404] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.064404] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.064404] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.064404] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.064404] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.066210] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: IN_PROGRESS for 2s [ 866.395328] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.568022] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbfb80ba-80ff-4142-b496-98bf89fbe02f: rpc.has_security_group_logging(os_id): False [ 866.569955] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a6edb0e-97b9-43a5-ad22-81f0519d71f5: rpc.has_security_group_logging(os_id): False [ 866.599579] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.599796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.599905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.600269] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.600408] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.600729] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.600905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.600976] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.601219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.601337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.601468] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f is going to be created. [ 866.604743] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.604920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.605037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.605305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.605426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.605720] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.605864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.605961] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.607564] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.607699] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.608019] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.608176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.608276] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.608527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.608646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.608927] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.609098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.609198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.609420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.609528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.609653] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 866.694101] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.694101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.694101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.694101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.694101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.698387] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.698649] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.698649] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.698783] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.698913] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.707981] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f in Status: IN_PROGRESS for 2s [ 866.716830] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 866.899210] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.899548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.899548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.900138] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.900138] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.900138] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c249e605-e5e9-4e19-9316-502e4084ec60 is going to be updated. [ 866.931688] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.931688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.931688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.931688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.931688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.943728] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: IN_PROGRESS for 2s [ 867.416472] env[65413]: INFO networking_nsxv3.common.synchronization [req-8d14a4bd-d774-4a67-a74e-856886f4ebd0 req-a209494f-b5a8-4643-b71e-d5c65f474574 tempest-ServersAdminTestJSON-1071948959 tempest-ServersAdminTestJSON-1071948959-project-member] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 867.417112] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 867.417470] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.417626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.417685] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.417905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.422459] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.422679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.422760] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.423070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.423299] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.423363] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.891806] env[65413]: INFO networking_nsxv3.common.synchronization [None req-35b096d2-a206-454f-9546-05e72e586859 None None] Enqueued Resource ID: b7192cc9-5f1e-4e78-a7f7-616207eadd9f with Priority: HIGHEST for action port [ 867.893294] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7192cc9-5f1e-4e78-a7f7-616207eadd9f with Priority: HIGHEST for action port [ 867.893725] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7192cc9-5f1e-4e78-a7f7-616207eadd9f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.893997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7192cc9-5f1e-4e78-a7f7-616207eadd9f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.894200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7192cc9-5f1e-4e78-a7f7-616207eadd9f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.894778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7192cc9-5f1e-4e78-a7f7-616207eadd9f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.894995] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7192cc9-5f1e-4e78-a7f7-616207eadd9f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.926971] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.046137] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: SUCCESS [ 868.046374] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.046554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.046771] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.046858] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.083826] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: SUCCESS [ 868.084076] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.285496] env[65413]: INFO networking_nsxv3.common.synchronization [req-800c0fc2-319d-440e-8c6f-124005a69df2 req-8d7f188e-490e-4a9b-9932-d65b91323834 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 with Priority: HIGHEST for action security_group_members [ 868.285707] env[65413]: INFO networking_nsxv3.common.synchronization [req-800c0fc2-319d-440e-8c6f-124005a69df2 req-8d7f188e-490e-4a9b-9932-d65b91323834 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 868.285879] env[65413]: INFO networking_nsxv3.common.synchronization [req-800c0fc2-319d-440e-8c6f-124005a69df2 req-8d7f188e-490e-4a9b-9932-d65b91323834 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGHEST for action security_group_members [ 868.286565] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 with Priority: HIGHEST for action security_group_members [ 868.286743] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 868.286853] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGHEST for action security_group_members [ 868.289012] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5418f194-c94f-4464-85c0-a5109c6b8ec2 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.289012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.289012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.289012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.289012] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.289012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.289012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.289012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.289012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.289012] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5418f194-c94f-4464-85c0-a5109c6b8ec2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.289789] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.289789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.289789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.289965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.290098] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.290293] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.290293] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.290456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.290538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.290725] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.291671] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbfb80ba-80ff-4142-b496-98bf89fbe02f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.291834] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.291912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.292025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.295026] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.295026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.295026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.295026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.295026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.295026] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.338474] env[65413]: INFO networking_nsxv3.common.synchronization [req-800c0fc2-319d-440e-8c6f-124005a69df2 req-8d7f188e-490e-4a9b-9932-d65b91323834 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 with Priority: HIGHEST for action security_group_rules [ 868.338660] env[65413]: INFO networking_nsxv3.common.synchronization [req-800c0fc2-319d-440e-8c6f-124005a69df2 req-8d7f188e-490e-4a9b-9932-d65b91323834 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 with Priority: HIGHEST for action security_group_members [ 868.338875] env[65413]: INFO networking_nsxv3.common.synchronization [req-800c0fc2-319d-440e-8c6f-124005a69df2 req-8d7f188e-490e-4a9b-9932-d65b91323834 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_rules [ 868.339060] env[65413]: INFO networking_nsxv3.common.synchronization [req-800c0fc2-319d-440e-8c6f-124005a69df2 req-8d7f188e-490e-4a9b-9932-d65b91323834 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 868.339197] env[65413]: INFO networking_nsxv3.common.synchronization [req-800c0fc2-319d-440e-8c6f-124005a69df2 req-8d7f188e-490e-4a9b-9932-d65b91323834 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGHEST for action security_group_rules [ 868.339320] env[65413]: INFO networking_nsxv3.common.synchronization [req-800c0fc2-319d-440e-8c6f-124005a69df2 req-8d7f188e-490e-4a9b-9932-d65b91323834 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGHEST for action security_group_members [ 868.339447] env[65413]: INFO networking_nsxv3.common.synchronization [req-800c0fc2-319d-440e-8c6f-124005a69df2 req-8d7f188e-490e-4a9b-9932-d65b91323834 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: aea91d42-16cf-40d3-af86-c9c9d0c1cd8e with Priority: HIGHEST for action port [ 868.341049] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 with Priority: HIGHEST for action security_group_rules [ 868.341513] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_rules [ 868.341633] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGHEST for action security_group_members [ 868.341732] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aea91d42-16cf-40d3-af86-c9c9d0c1cd8e with Priority: HIGHEST for action port [ 868.341845] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGHEST for action security_group_rules [ 868.341928] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 with Priority: HIGHEST for action security_group_members [ 868.342095] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 868.342471] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5418f194-c94f-4464-85c0-a5109c6b8ec2 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.342624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.342711] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.343067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.343193] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5418f194-c94f-4464-85c0-a5109c6b8ec2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.344326] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.344457] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.344742] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbfb80ba-80ff-4142-b496-98bf89fbe02f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.344823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.345339] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.345496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.345592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.345859] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.345972] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('aea91d42-16cf-40d3-af86-c9c9d0c1cd8e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.346818] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbfb80ba-80ff-4142-b496-98bf89fbe02f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.346897] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.347280] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5418f194-c94f-4464-85c0-a5109c6b8ec2 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.347383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.347594] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.347727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.397601] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7192cc9-5f1e-4e78-a7f7-616207eadd9f [ 868.397898] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.398102] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.398175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.398398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.398490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.398582] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7192cc9-5f1e-4e78-a7f7-616207eadd9f already deleted. [ 868.398670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7192cc9-5f1e-4e78-a7f7-616207eadd9f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.430109] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.549878] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.550011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.725566] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f in Status: SUCCESS [ 868.725566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.725566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.725566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.725566] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.733850] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 868.734063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.734248] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.734486] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.734574] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.794733] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5418f194-c94f-4464-85c0-a5109c6b8ec2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.796605] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.798026] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.849265] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port aea91d42-16cf-40d3-af86-c9c9d0c1cd8e with status ACTIVE [ 868.849597] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.849684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.849726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.850493] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.850493] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.850493] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.850493] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.850493] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.850493] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.850716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.850716] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.850809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.851132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.851132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.851209] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.851234] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: aea91d42-16cf-40d3-af86-c9c9d0c1cd8e is going to be updated. [ 868.852430] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5418f194-c94f-4464-85c0-a5109c6b8ec2 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.852563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.874573] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.874728] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.874799] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.875025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.875192] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.875330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-aea91d42-16cf-40d3-af86-c9c9d0c1cd8e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.935684] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.936052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.936052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.936215] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.936274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.936396] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be updated. [ 868.953131] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: SUCCESS [ 868.954357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.954357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.954357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.954357] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.954357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.954357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.954357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.954357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.954629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.954629] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.995024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.995242] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.995348] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.995635] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.995818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.028870] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: IN_PROGRESS for 2s [ 869.226906] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbfb80ba-80ff-4142-b496-98bf89fbe02f taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.227193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.237850] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.238054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.298679] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5418f194-c94f-4464-85c0-a5109c6b8ec2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.300315] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.301254] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.457041] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.457207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.457280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.457505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.457812] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.457812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.457812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.458229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.458229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.458229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.458346] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.458410] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.458441] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.458572] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.458706] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.458901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.458969] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.459153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.459243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.459351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.459391] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.804286] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.805108] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.805108] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.805108] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.805108] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.805108] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 is going to be created. [ 869.807055] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.807055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.807055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.807055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.807055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.807334] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 869.808202] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.808302] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.808369] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.808522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.808601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.808685] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f is going to be updated. [ 869.874439] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.874602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.874656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.874947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.875214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.878444] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.878583] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.878654] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.878868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.879152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.888228] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.888405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.888454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.888687] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.888871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.902639] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f in Status: IN_PROGRESS for 2s [ 869.903519] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 in Status: UNINITIALIZED for 2s [ 869.904181] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 869.961748] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c249e605-e5e9-4e19-9316-502e4084ec60: rpc.has_security_group_logging(os_id): False [ 869.983263] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.983440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.983476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.983791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.983930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.984199] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.984349] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.984462] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.984687] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.984800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.985164] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.985338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.985521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.985818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.986029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.986429] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.986671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.986868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.987086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.987298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.987429] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c249e605-e5e9-4e19-9316-502e4084ec60 is going to be updated. [ 870.084666] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.084666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.084666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.084992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.085691] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.107677] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: IN_PROGRESS for 2s [ 870.927700] env[65413]: INFO networking_nsxv3.common.synchronization [req-55743b63-f153-42b0-8845-db36b7ede408 req-5887b809-9f25-4fa8-95fa-81a320e5001c tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 with Priority: HIGHEST for action security_group_members [ 870.927700] env[65413]: INFO networking_nsxv3.common.synchronization [req-55743b63-f153-42b0-8845-db36b7ede408 req-5887b809-9f25-4fa8-95fa-81a320e5001c tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 870.927977] env[65413]: INFO networking_nsxv3.common.synchronization [req-55743b63-f153-42b0-8845-db36b7ede408 req-5887b809-9f25-4fa8-95fa-81a320e5001c tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGHEST for action security_group_members [ 870.928426] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 with Priority: HIGHEST for action security_group_members [ 870.928562] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 870.928658] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGHEST for action security_group_members [ 870.928977] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5418f194-c94f-4464-85c0-a5109c6b8ec2 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.929493] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.930298] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.930403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.930604] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbfb80ba-80ff-4142-b496-98bf89fbe02f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.930686] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.042146] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 871.042146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.797803] env[65413]: INFO networking_nsxv3.common.synchronization [req-7e37865c-0581-49e7-b75c-0d7b53736dad req-51ec2211-3f57-48e3-9a3b-250b006a3d3f tempest-ImagesOneServerNegativeTestJSON-1663656844 tempest-ImagesOneServerNegativeTestJSON-1663656844-project-member] Enqueued Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 871.798437] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 with Priority: HIGHEST for action security_group_members [ 871.798766] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3d036f63-388f-4a40-b3dc-855ae378cbe3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.798888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.799028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.799256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.799413] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.799533] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.799607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.799775] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.799860] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.799959] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3d036f63-388f-4a40-b3dc-855ae378cbe3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.916728] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 in Status: SUCCESS [ 871.917514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.917514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.917514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.917649] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.917774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.917878] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.918088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.918915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.918915] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5418f194-c94f-4464-85c0-a5109c6b8ec2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.920546] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 871.920546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.921341] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f in Status: SUCCESS [ 871.921341] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.921341] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.921481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.921722] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.921722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.921722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.921995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.922351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.922715] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.923648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.923648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.923757] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.923861] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.923932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.924736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.924736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.924736] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.132391] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: SUCCESS [ 872.132693] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.303873] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.304052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.304127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.304343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.304431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.304645] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.304742] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.304797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.304945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.305080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.305152] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 is going to be updated. [ 872.333608] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.333857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.333857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.334036] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.334193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.347546] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: IN_PROGRESS for 2s [ 872.426718] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.426718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.426718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.426972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.426972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.427172] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.427445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.427445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.427550] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.427550] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.427631] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 is going to be deleted. [ 872.428661] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.429779] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.429919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.429970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.430130] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.430228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.430392] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.430495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.430590] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.430774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.430852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.430937] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f is going to be updated. [ 872.503631] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.503631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.503631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.503853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.503853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.506071] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.506199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.506199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.506391] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.506476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.506627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.507126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.507305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.507479] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.507583] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.507683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.507789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.507868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.507962] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5418f194-c94f-4464-85c0-a5109c6b8ec2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.518338] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f in Status: IN_PROGRESS for 2s [ 872.933281] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.011673] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.012268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.012268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.012364] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.012393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.012613] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.012719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.012782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.012958] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.013045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.013136] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 already deleted. [ 873.013219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.013340] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5418f194-c94f-4464-85c0-a5109c6b8ec2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.017676] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.017873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.018245] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.018376] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.018480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.018622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.018781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.018855] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5418f194-c94f-4464-85c0-a5109c6b8ec2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.408102] env[65413]: INFO networking_nsxv3.common.synchronization [req-d3c99155-8eab-4f66-a0fc-4aae2dd76298 req-292f7317-068b-4d45-adda-5bcd267dd4ec tempest-ServersNegativeTestMultiTenantJSON-48040970 tempest-ServersNegativeTestMultiTenantJSON-48040970-project-member] Enqueued Resource ID: 924c9188-b4e7-4597-a445-d583984b729f with Priority: HIGHEST for action security_group_members [ 873.409262] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 924c9188-b4e7-4597-a445-d583984b729f with Priority: HIGHEST for action security_group_members [ 873.409487] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-924c9188-b4e7-4597-a445-d583984b729f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.409593] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.409645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.409880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.410063] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.410719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.410719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.410719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.410719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.410719] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('924c9188-b4e7-4597-a445-d583984b729f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.436401] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.436565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.436639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.436873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.439655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.439655] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 873.471552] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.471983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.471983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.472227] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.472310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.485162] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 873.521498] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5418f194-c94f-4464-85c0-a5109c6b8ec2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.522628] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.522767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.522835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.523060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.523161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.523429] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.523573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.523658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.523882] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.523992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.524114] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 already deleted. [ 873.524201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.528319] env[65413]: INFO networking_nsxv3.common.synchronization [req-96411a97-4a30-45d1-8e9d-46c59122f033 req-8033a567-66ab-412c-af6f-4508e3bff56e tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 873.528843] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 873.529430] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.529430] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.529430] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.529726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.529883] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.529988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.530084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.530245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.530328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.530421] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.804702] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-388 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.804702] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-388" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.804702] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-388" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.804954] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-388" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.805291] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.805460] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.805814] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.805906] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.806183] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.806819] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.806819] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.806819] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.806819] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.806819] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.806819] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.807075] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.827959] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.828180] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 873.828298] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.828476] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-388" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.828798] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-e94a5cd2-9166-491d-9778-fdcc75012a4f taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.829155] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-e94a5cd2-9166-491d-9778-fdcc75012a4f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.829302] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-e94a5cd2-9166-491d-9778-fdcc75012a4f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.829661] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-e94a5cd2-9166-491d-9778-fdcc75012a4f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.829816] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e94a5cd2-9166-491d-9778-fdcc75012a4f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.917275] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.917275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.917275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.917275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.917275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.917275] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.917275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.919022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.919022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.919022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.919022] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 924c9188-b4e7-4597-a445-d583984b729f already deleted. [ 873.919022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.027423] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5418f194-c94f-4464-85c0-a5109c6b8ec2: rpc.has_security_group_logging(os_id): False [ 874.032914] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.032914] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.032914] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.033142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.033299] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.033614] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.033701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.033701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.033950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.033998] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.034065] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be updated. [ 874.047592] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.047836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.047962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.048335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.048523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.048936] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.049129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.049268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.049537] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.049670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.049935] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 is going to be created. [ 874.063941] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.064129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.064129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.064393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.064535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.072204] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/5418f194-c94f-4464-85c0-a5109c6b8ec2], does not exist path=[/infra/domains/default/groups/5418f194-c94f-4464-85c0-a5109c6b8ec2]."\n}' [ 874.072378] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5418f194-c94f-4464-85c0-a5109c6b8ec2 [ 874.072458] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 874.073951] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 874.127024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.127302] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.127302] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.127616] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.129466] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.129466] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.129466] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.129466] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.130312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.130312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.130312] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.130312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.130312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.130466] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.130466] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.131208] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5418f194-c94f-4464-85c0-a5109c6b8ec2 is going to be created. [ 874.153733] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/5418f194-c94f-4464-85c0-a5109c6b8ec2], does not exist path=[/infra/domains/default/groups/5418f194-c94f-4464-85c0-a5109c6b8ec2]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5418f194-c94f-4464-85c0-a5109c6b8ec2 [ 874.153909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5418f194-c94f-4464-85c0-a5109c6b8ec2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.154046] env[65413]: Traceback (most recent call last): [ 874.154102] env[65413]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 874.154102] env[65413]: return func(*args, **kwargs) [ 874.154102] env[65413]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 874.154102] env[65413]: res.raise_for_status() [ 874.154102] env[65413]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 874.154102] env[65413]: raise HTTPError(http_error_msg, response=self) [ 874.154102] env[65413]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5418f194-c94f-4464-85c0-a5109c6b8ec2 [ 874.154102] env[65413]: During handling of the above exception, another exception occurred: [ 874.154102] env[65413]: Traceback (most recent call last): [ 874.154301] env[65413]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 874.154301] env[65413]: listener.cb(fileno) [ 874.154301] env[65413]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 874.154301] env[65413]: result = function(*args, **kwargs) [ 874.154301] env[65413]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 874.154301] env[65413]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 874.154301] env[65413]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 874.154301] env[65413]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 874.154301] env[65413]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 874.154301] env[65413]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 874.154301] env[65413]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 874.154301] env[65413]: res.raise_for_status() [ 874.154301] env[65413]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 874.154301] env[65413]: raise HTTPError(http_error_msg, response=self) [ 874.154301] env[65413]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/5418f194-c94f-4464-85c0-a5109c6b8ec2 [ 874.154301] env[65413]: Removing descriptor: 61 [ 874.339024] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.339024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.339024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.339024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.339024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.339024] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port e94a5cd2-9166-491d-9778-fdcc75012a4f not found, creating... [ 874.339024] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.339024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.339024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.339024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.339024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.339506] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.339506] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.339506] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.339506] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.339506] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.340088] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: e94a5cd2-9166-491d-9778-fdcc75012a4f is going to be created. [ 874.361810] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 in Status: SUCCESS [ 874.361810] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3d036f63-388f-4a40-b3dc-855ae378cbe3 deletion is rescheduled due to dependency. [ 874.361810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3d036f63-388f-4a40-b3dc-855ae378cbe3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.367387] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.367487] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.367524] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.367819] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.368067] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.368393] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-e94a5cd2-9166-491d-9778-fdcc75012a4f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.534205] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f in Status: SUCCESS [ 874.534576] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f deletion is rescheduled due to dependency. [ 874.534576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.534781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.534970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.535181] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.535452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.535523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.535702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.535785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.535872] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.535985] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.537072] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.537270] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.537439] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.537546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.537609] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.537753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.537827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.537924] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.039551] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.041106] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.041472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.041472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.041472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.069337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.069638] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.069762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.069829] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.070349] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.070349] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.070349] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f is going to be updated. [ 875.103371] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.105244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.105244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.105244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.105244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.113776] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f in Status: IN_PROGRESS for 2s [ 875.497533] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 875.497738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.499784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.499784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.499784] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.499784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.499784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.499784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.499784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.499784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.499784] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.500099] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.500216] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.500376] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.500480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.500543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.500686] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.500763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.500849] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.546460] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbfb80ba-80ff-4142-b496-98bf89fbe02f: rpc.has_security_group_logging(os_id): False [ 875.566788] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.566934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.567019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.567234] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.567320] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.567548] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.568066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.568066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.568066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.568066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.568066] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f is going to be updated. [ 875.578946] env[65413]: INFO networking_nsxv3.common.synchronization [req-d3c99155-8eab-4f66-a0fc-4aae2dd76298 req-9dc278ba-58d9-405a-b9c2-9a40d78a0419 service nova] Enqueued Resource ID: 924c9188-b4e7-4597-a445-d583984b729f with Priority: HIGHEST for action security_group_rules [ 875.578946] env[65413]: INFO networking_nsxv3.common.synchronization [req-d3c99155-8eab-4f66-a0fc-4aae2dd76298 req-9dc278ba-58d9-405a-b9c2-9a40d78a0419 service nova] Enqueued Resource ID: 924c9188-b4e7-4597-a445-d583984b729f with Priority: HIGHEST for action security_group_members [ 875.579168] env[65413]: INFO networking_nsxv3.common.synchronization [req-d3c99155-8eab-4f66-a0fc-4aae2dd76298 req-9dc278ba-58d9-405a-b9c2-9a40d78a0419 service nova] Enqueued Resource ID: e94a5cd2-9166-491d-9778-fdcc75012a4f with Priority: HIGHEST for action port [ 875.579727] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 924c9188-b4e7-4597-a445-d583984b729f with Priority: HIGHEST for action security_group_rules [ 875.579727] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 924c9188-b4e7-4597-a445-d583984b729f with Priority: HIGHEST for action security_group_members [ 875.579829] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e94a5cd2-9166-491d-9778-fdcc75012a4f with Priority: HIGHEST for action port [ 875.580859] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-924c9188-b4e7-4597-a445-d583984b729f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.581065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.581113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.581343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.581425] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('924c9188-b4e7-4597-a445-d583984b729f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.582346] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-924c9188-b4e7-4597-a445-d583984b729f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.582528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.582528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.582778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.582944] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.582944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.583055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.583151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.583234] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.583339] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('924c9188-b4e7-4597-a445-d583984b729f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.584176] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-e94a5cd2-9166-491d-9778-fdcc75012a4f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.584258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e94a5cd2-9166-491d-9778-fdcc75012a4f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.584287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e94a5cd2-9166-491d-9778-fdcc75012a4f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.584713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e94a5cd2-9166-491d-9778-fdcc75012a4f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.584713] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e94a5cd2-9166-491d-9778-fdcc75012a4f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.636484] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.636655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.636716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.636915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.637055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.657804] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f in Status: IN_PROGRESS for 2s [ 875.990818] env[65413]: INFO networking_nsxv3.common.synchronization [req-3fe7f58c-74ee-4b18-a6e5-3d7cad84d3a2 req-e0c20de6-8617-482a-9e14-68861bb441f4 tempest-ServerActionsTestOtherA-276981019 tempest-ServerActionsTestOtherA-276981019-project-member] Enqueued Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_members [ 875.991334] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_members [ 875.991672] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba978295-db66-4f6f-800c-d69ad3fc5fec taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.991805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.991975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.992377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.993533] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.993533] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.993533] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.993735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.993735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.993872] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.002984] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.003214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.004132] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.086945] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 876.087450] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 deletion is rescheduled due to dependency. [ 876.087450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.087450] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-924c9188-b4e7-4597-a445-d583984b729f taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.087580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.088323] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('924c9188-b4e7-4597-a445-d583984b729f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.088747] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e94a5cd2-9166-491d-9778-fdcc75012a4f with status ACTIVE [ 876.088958] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.089857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.089961] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.090421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.090912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.091995] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.091995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.091995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.091995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.091995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.091995] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.091995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.092746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.092746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.092746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.092746] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e94a5cd2-9166-491d-9778-fdcc75012a4f is going to be updated. [ 876.117981] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.117981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.117981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.117981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.118352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.118352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e94a5cd2-9166-491d-9778-fdcc75012a4f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.462375] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-598 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.462604] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.462743] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.463257] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.463901] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.464094] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.464230] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.464457] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.464749] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.464825] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.464976] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.465027] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.465142] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.465249] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.465349] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.465482] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.487304] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.487534] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 876.487676] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.487924] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.488314] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-25c90991-f9c9-4cb1-9561-dd3f59865ed0 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.488502] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-25c90991-f9c9-4cb1-9561-dd3f59865ed0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.488623] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-25c90991-f9c9-4cb1-9561-dd3f59865ed0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.488970] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-25c90991-f9c9-4cb1-9561-dd3f59865ed0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.489154] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25c90991-f9c9-4cb1-9561-dd3f59865ed0',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.496121] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.496271] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.496344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.496555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.496645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.496874] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.496987] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.497050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.497228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.497329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.497393] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba978295-db66-4f6f-800c-d69ad3fc5fec already deleted. [ 876.497472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.508028] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.513865] env[65413]: INFO networking_nsxv3.common.synchronization [req-92c31143-3757-45b0-b69f-c9a198e83afc req-5db4e95e-cb70-4d37-b30c-eb115edc76b5 tempest-DeleteServersTestJSON-2008533967 tempest-DeleteServersTestJSON-2008533967-project-member] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 876.515079] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 876.515474] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.515610] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.515662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.515849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.516012] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.516134] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.516206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.516323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.516408] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.516495] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.595486] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('924c9188-b4e7-4597-a445-d583984b729f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.992423] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.992691] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.992835] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.993192] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.993387] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.993577] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 25c90991-f9c9-4cb1-9561-dd3f59865ed0 not found, creating... [ 876.993883] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.994080] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.994205] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.994451] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.994612] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.994979] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.995242] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.995372] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.995658] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.995813] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.995958] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 25c90991-f9c9-4cb1-9561-dd3f59865ed0 is going to be created. [ 877.009331] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.009595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.009754] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.010077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.010338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.010490] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 877.018965] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.019454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.019454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.019851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.026107] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.026505] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.026745] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.027266] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.027687] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.029184] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-25c90991-f9c9-4cb1-9561-dd3f59865ed0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.052034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.052034] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.052034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.052034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.052034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.052034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.052034] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 877.066660] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.066879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.067046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.067305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.067494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.098500] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 877.100963] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.101289] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.101359] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.101583] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.101671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.101772] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 924c9188-b4e7-4597-a445-d583984b729f is going to be created. [ 877.131069] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f in Status: SUCCESS [ 877.131355] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f deletion is rescheduled due to dependency. [ 877.131512] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.140208] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.140397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.140397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.140594] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.140757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.149291] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.149456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.149516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.149782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.149901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.159233] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 877.174619] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 924c9188-b4e7-4597-a445-d583984b729f in Status: UNINITIALIZED for 2s [ 877.499314] env[65413]: INFO networking_nsxv3.common.synchronization [req-ace372d9-6002-4a75-85d2-4de9e4d8ae87 req-55a62a7e-3a2a-4fee-9e9b-a720378e6776 tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGHEST for action security_group_members [ 877.499854] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGHEST for action security_group_members [ 877.500177] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.500310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.500374] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.500586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.500739] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.500837] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.500921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.501100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.501202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.501278] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fcfdc2e3-2cc7-44cc-8355-9f87d267f435',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.670893] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f in Status: SUCCESS [ 877.671304] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.731834] env[65413]: INFO networking_nsxv3.common.synchronization [req-3fe7f58c-74ee-4b18-a6e5-3d7cad84d3a2 req-401398e5-5e3f-4839-82d1-11033d4972f8 service nova] Enqueued Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_rules [ 877.731937] env[65413]: INFO networking_nsxv3.common.synchronization [req-3fe7f58c-74ee-4b18-a6e5-3d7cad84d3a2 req-401398e5-5e3f-4839-82d1-11033d4972f8 service nova] Enqueued Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_members [ 877.732164] env[65413]: INFO networking_nsxv3.common.synchronization [req-3fe7f58c-74ee-4b18-a6e5-3d7cad84d3a2 req-401398e5-5e3f-4839-82d1-11033d4972f8 service nova] Enqueued Resource ID: 25c90991-f9c9-4cb1-9561-dd3f59865ed0 with Priority: HIGHEST for action port [ 877.733067] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_rules [ 877.733067] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_members [ 877.733184] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25c90991-f9c9-4cb1-9561-dd3f59865ed0 with Priority: HIGHEST for action port [ 877.733577] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba978295-db66-4f6f-800c-d69ad3fc5fec taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.733681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.733793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.734031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.734171] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.735157] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba978295-db66-4f6f-800c-d69ad3fc5fec taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.735288] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.735353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.735632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.735881] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.736044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.736146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.736343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.736429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.736533] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.737524] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-25c90991-f9c9-4cb1-9561-dd3f59865ed0 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.737639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25c90991-f9c9-4cb1-9561-dd3f59865ed0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.737705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25c90991-f9c9-4cb1-9561-dd3f59865ed0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.738125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25c90991-f9c9-4cb1-9561-dd3f59865ed0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.738246] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25c90991-f9c9-4cb1-9561-dd3f59865ed0',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.994720] env[65413]: INFO networking_nsxv3.common.synchronization [req-c4f05b5e-5f58-43c7-b538-7aed332acccd req-60507b6d-8a0f-4411-86bf-09900913650b tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b with Priority: HIGHEST for action security_group_members [ 877.994720] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b with Priority: HIGHEST for action security_group_members [ 877.994720] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.994720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.994720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.994720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.995179] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.995179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.995179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.996062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.996062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.996062] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.004202] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.004406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.005261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.005261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.029740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.029740] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.029740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.029740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.030062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.030062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.030062] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 is going to be updated. [ 878.069392] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.069564] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.069644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.069914] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.070207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.085223] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 in Status: IN_PROGRESS for 2s [ 878.242053] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.243615] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba978295-db66-4f6f-800c-d69ad3fc5fec taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.244194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.244696] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25c90991-f9c9-4cb1-9561-dd3f59865ed0 with status ACTIVE [ 878.245036] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.245319] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.245663] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.246257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.246257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.246550] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.250393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.250393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.250393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.250393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.250393] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.250393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.250393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.250393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.250393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.250393] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25c90991-f9c9-4cb1-9561-dd3f59865ed0 is going to be updated. [ 878.274947] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.275132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.275132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.275323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.275465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.275631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25c90991-f9c9-4cb1-9561-dd3f59865ed0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.500243] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.500600] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.502201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.502509] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.527651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.527957] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.528118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.528184] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.528488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.528586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.528711] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b is going to be updated. [ 878.563741] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.563959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.563998] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.564283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.564433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.576437] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b in Status: IN_PROGRESS for 2s [ 878.610326] env[65413]: INFO networking_nsxv3.common.synchronization [req-9c355751-0571-4710-a942-48942f165de6 req-d8f513df-0033-48c9-ba60-103ac1dcbbee tempest-ImagesTestJSON-1309992501 tempest-ImagesTestJSON-1309992501-project-member] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 878.610998] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 878.611370] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.611501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.611577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.611782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.612664] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.612799] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.612865] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.613051] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.613161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.613304] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.746632] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.015551] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-954 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.015551] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.015893] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.016266] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.017387] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.017387] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.017387] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.017387] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.017387] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.017662] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.017811] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 879.017931] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 879.018067] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 879.018184] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 879.018289] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 879.018438] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 879.041931] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 879.042133] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 879.042297] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 879.042487] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.042904] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-14f078c1-737b-4110-a2ad-007c4dd28f3e taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.043039] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-14f078c1-737b-4110-a2ad-007c4dd28f3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.043145] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-14f078c1-737b-4110-a2ad-007c4dd28f3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.043596] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-14f078c1-737b-4110-a2ad-007c4dd28f3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.044096] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14f078c1-737b-4110-a2ad-007c4dd28f3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.108996] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 879.109275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.109774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.109774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.109904] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.109961] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.110356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.110589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.110718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.110846] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.111117] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.111532] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.111532] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.111532] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.111729] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.111905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.112144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.112409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.112608] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.112742] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.112869] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.116431] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.116597] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.116680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.122034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.145982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.146275] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.146434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.146794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.147038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.147130] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.147224] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 879.170118] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 879.170372] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 deletion is rescheduled due to dependency. [ 879.170519] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.251276] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.251638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.251638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.252307] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.252307] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.252307] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba978295-db66-4f6f-800c-d69ad3fc5fec is going to be created. [ 879.300042] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.300042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.300042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.300042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.300042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.314738] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 924c9188-b4e7-4597-a445-d583984b729f in Status: SUCCESS [ 879.314953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.315148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.315387] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.315590] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.315724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.315818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.316017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.316162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.316298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.316470] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('924c9188-b4e7-4597-a445-d583984b729f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.318224] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 879.332889] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.332889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.332889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.333179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.333264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.338405] env[65413]: INFO networking_nsxv3.common.synchronization [req-0fe8a792-d5f1-4edc-9277-34088ef29d26 req-cde06957-d47c-4d19-b873-abace9209989 tempest-MigrationsAdminTest-1569866777 tempest-MigrationsAdminTest-1569866777-project-member] Enqueued Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_members [ 879.338852] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGHEST for action security_group_members [ 879.339289] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.339460] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.339554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.339827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.340383] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.341079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.341079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.341079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.341079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.341079] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.350134] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: UNINITIALIZED for 2s [ 879.549924] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.550270] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.550463] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.550836] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.551122] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.551373] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 14f078c1-737b-4110-a2ad-007c4dd28f3e not found, creating... [ 879.551818] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.552060] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.552363] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.552766] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.553039] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.553596] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.553931] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.554116] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.554497] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.554728] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.555014] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 14f078c1-737b-4110-a2ad-007c4dd28f3e is going to be created. [ 879.585450] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.585759] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.585926] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.586306] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.586603] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.586872] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-14f078c1-737b-4110-a2ad-007c4dd28f3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.615263] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a6edb0e-97b9-43a5-ad22-81f0519d71f5: rpc.has_security_group_logging(os_id): False [ 879.639427] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.639529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.639612] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.639872] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.683083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.683577] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.683778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.683882] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.684236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.684371] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.684717] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.684889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.684987] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.685268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.685426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.685682] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.685838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.685935] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.686191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.686315] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.686444] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 879.783575] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.783987] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.783987] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.784097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.784307] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.798471] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 879.819275] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-924c9188-b4e7-4597-a445-d583984b729f taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.819524] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.819590] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.819901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.820088] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.820203] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.820282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.820465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.820566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.820682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.820857] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-924c9188-b4e7-4597-a445-d583984b729f taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.821073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.821073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.821261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.821425] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.821545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.821637] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.821796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.821876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.821959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.822161] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('924c9188-b4e7-4597-a445-d583984b729f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.844162] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.844329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.844403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.844620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.900458] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.900541] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.900649] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.901203] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.901203] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.901203] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.901314] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af248d88-efaa-44cd-99ca-972413455b63 is going to be updated. [ 879.957666] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.957864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.957864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.958216] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.958278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.977038] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: IN_PROGRESS for 2s [ 880.096677] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 in Status: SUCCESS [ 880.096895] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 deletion is rescheduled due to dependency. [ 880.097245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.324318] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 924c9188-b4e7-4597-a445-d583984b729f: rpc.has_security_group_logging(os_id): False [ 880.333021] env[65413]: INFO networking_nsxv3.common.synchronization [req-9c355751-0571-4710-a942-48942f165de6 req-04ade164-ed76-4a62-bf42-67a4121f3741 service nova] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_rules [ 880.333021] env[65413]: INFO networking_nsxv3.common.synchronization [req-9c355751-0571-4710-a942-48942f165de6 req-04ade164-ed76-4a62-bf42-67a4121f3741 service nova] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 880.333021] env[65413]: INFO networking_nsxv3.common.synchronization [req-9c355751-0571-4710-a942-48942f165de6 req-04ade164-ed76-4a62-bf42-67a4121f3741 service nova] Enqueued Resource ID: 14f078c1-737b-4110-a2ad-007c4dd28f3e with Priority: HIGHEST for action port [ 880.333021] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_rules [ 880.333021] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 880.333021] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14f078c1-737b-4110-a2ad-007c4dd28f3e with Priority: HIGHEST for action port [ 880.333590] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.333934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.334105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.334548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.334763] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.336510] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.337477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.337548] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-14f078c1-737b-4110-a2ad-007c4dd28f3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.337679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14f078c1-737b-4110-a2ad-007c4dd28f3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.337712] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14f078c1-737b-4110-a2ad-007c4dd28f3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.339447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14f078c1-737b-4110-a2ad-007c4dd28f3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.339447] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14f078c1-737b-4110-a2ad-007c4dd28f3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.359328] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.360588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.360588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.360588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.360588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.360588] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.360811] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.360811] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.360864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.360926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.361160] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.361257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.361438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.361496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.361524] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.361692] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.361782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.361840] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.362442] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.362442] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.362544] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 924c9188-b4e7-4597-a445-d583984b729f is going to be created. [ 880.456882] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.457067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.457155] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.457477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.457850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.477194] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 924c9188-b4e7-4597-a445-d583984b729f in Status: IN_PROGRESS for 2s [ 880.594705] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b in Status: SUCCESS [ 880.595442] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b deletion is rescheduled due to dependency. [ 880.595787] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.840137] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.840444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.841506] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14f078c1-737b-4110-a2ad-007c4dd28f3e with status ACTIVE [ 880.841506] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.841506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.841506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.841506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.841506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.841506] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.841985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.841985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.841985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.841985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.842182] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.842227] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.842467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.842467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.842467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.842596] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14f078c1-737b-4110-a2ad-007c4dd28f3e is going to be updated. [ 880.868473] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.868585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.868660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.869013] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.869160] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.869322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14f078c1-737b-4110-a2ad-007c4dd28f3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.234765] env[65413]: INFO networking_nsxv3.common.synchronization [req-3e1cedf1-0b28-4809-8654-2ea9576918e0 req-1863f356-7c2d-49e8-8187-3623444dd3ad tempest-ServersNegativeTestJSON-1140018984 tempest-ServersNegativeTestJSON-1140018984-project-member] Enqueued Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_members [ 881.235633] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_members [ 881.236134] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.236417] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.236417] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.236618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.236755] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.237170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.237170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.237357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.237357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.237462] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.334906] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 881.334906] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 deletion is rescheduled due to dependency. [ 881.334906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.334906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.334906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.334906] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.334906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.334906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.335960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.335960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.335960] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.359872] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: SUCCESS [ 881.360131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.360291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.360522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.360711] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.360859] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.360900] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.361070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.361168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.361254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.361343] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.649463] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-508 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.649779] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.649958] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.650382] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.650748] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.650950] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.651138] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.651402] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.651591] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.651829] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.651968] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.652121] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.652293] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.652436] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.652564] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.652731] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.673365] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.673557] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 881.673695] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.673866] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.674275] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.674489] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.674617] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.674930] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.675192] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.741940] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.741940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.741940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.741940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.741940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.741940] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.741940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.741940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.741940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.741940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.741940] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e already deleted. [ 881.741940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.813817] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 881.813817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.841156] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.864018] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.989165] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af248d88-efaa-44cd-99ca-972413455b63 in Status: SUCCESS [ 881.990356] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af248d88-efaa-44cd-99ca-972413455b63 deletion is rescheduled due to dependency. [ 881.990356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.177406] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.177660] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.177819] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.178210] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.178359] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.178787] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd not found, creating... [ 882.178862] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.179169] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.179296] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.179538] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.179675] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.180016] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.180192] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.180386] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.180641] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.180773] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.180940] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd is going to be created. [ 882.207785] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.208114] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.208306] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.208627] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.208988] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.209301] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.344109] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.365370] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba978295-db66-4f6f-800c-d69ad3fc5fec: rpc.has_security_group_logging(os_id): False [ 882.391839] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.391839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.391839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.391839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.391839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.391839] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.391839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.391839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.391839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.391839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.391839] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba978295-db66-4f6f-800c-d69ad3fc5fec is going to be created. [ 882.475023] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.475023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.475023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.475023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.475023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.485283] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: IN_PROGRESS for 2s [ 882.487481] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 924c9188-b4e7-4597-a445-d583984b729f in Status: SUCCESS [ 882.487481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.848449] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.848984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.848984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.848984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.848984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.849256] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 882.882266] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.882758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.882758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.882758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.883847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.893473] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 882.963722] env[65413]: INFO networking_nsxv3.common.synchronization [req-3e1cedf1-0b28-4809-8654-2ea9576918e0 req-b5e283ee-b702-4ee4-82bb-744cf96e8c86 service nova] Enqueued Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_rules [ 882.964370] env[65413]: INFO networking_nsxv3.common.synchronization [req-3e1cedf1-0b28-4809-8654-2ea9576918e0 req-b5e283ee-b702-4ee4-82bb-744cf96e8c86 service nova] Enqueued Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_members [ 882.964525] env[65413]: INFO networking_nsxv3.common.synchronization [req-3e1cedf1-0b28-4809-8654-2ea9576918e0 req-b5e283ee-b702-4ee4-82bb-744cf96e8c86 service nova] Enqueued Resource ID: c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd with Priority: HIGHEST for action port [ 882.965568] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_rules [ 882.965568] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_members [ 882.965568] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd with Priority: HIGHEST for action port [ 882.965723] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.965849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.965911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.966221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.966328] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.967820] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.967820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.967820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.967820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.968037] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.968037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.968037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.968211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.968280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.968767] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.970372] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.970372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.970372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.970372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.970372] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.474386] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.474386] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.474386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.474386] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd with status ACTIVE [ 883.474386] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.474386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.474386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.474727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.476073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.476073] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.476073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.476073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.476073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.476073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.476073] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.476073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.476073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.476073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.476073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.476490] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd is going to be updated. [ 883.499648] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.500029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.500105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.500430] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.500576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.500736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.852920] env[65413]: INFO networking_nsxv3.common.synchronization [req-7db107f0-f8de-4536-b664-12a919fbfffa req-075b00b5-4539-4d20-87e6-bbcd1877f05b tempest-ServersTestMultiNic-1690690875 tempest-ServersTestMultiNic-1690690875-project-member] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 883.853462] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 883.853757] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.853878] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.853944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.854351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.854535] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.854681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.854852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.855132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.855312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.855414] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.978837] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.324863] env[65413]: INFO networking_nsxv3.common.synchronization [req-7db107f0-f8de-4536-b664-12a919fbfffa req-2258ed07-b74a-438d-84cc-1cf76e7f68d9 tempest-ServersTestMultiNic-1690690875 tempest-ServersTestMultiNic-1690690875-project-member] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 884.325798] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 884.326293] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.326449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.357877] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.358128] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.358208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.358436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.358528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.358772] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.358956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.359128] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.359331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.359412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.359521] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 already deleted. [ 884.359609] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.360166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.360334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.360500] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.360601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.360664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.361655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.361655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.361655] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.483465] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.483678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.483760] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.484034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.484547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.484547] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e is going to be created. [ 884.504239] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: SUCCESS [ 884.504476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.513154] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.513389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.513389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.513638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.513774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.527035] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: UNINITIALIZED for 2s [ 884.759709] env[65413]: INFO networking_nsxv3.common.synchronization [req-7db107f0-f8de-4536-b664-12a919fbfffa req-7265127b-ef8e-4814-8a5e-972c6addc98e tempest-ServersTestMultiNic-1690690875 tempest-ServersTestMultiNic-1690690875-project-member] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 884.759709] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 884.760042] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.760213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.863888] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.866807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.866807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.866807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.866807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.866807] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.866807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.866807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.866807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.866807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.866807] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 already deleted. [ 884.866807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.866807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.866807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.866807] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.866807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.866807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.866807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.866807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.866807] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.906646] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 884.906646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.906646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.906646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.906646] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.906646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.906646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.906646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.906646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.906646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.906646] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.236935] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.237177] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.237320] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.237979] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.237979] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.238172] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.238344] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.238599] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.238950] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.239306] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.239306] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 885.239306] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 885.239498] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 885.239552] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 885.239670] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 885.239942] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 885.259195] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 885.259398] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 885.259488] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 885.259661] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.259975] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.260160] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.260277] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.260618] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.260755] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.370041] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.370242] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.370349] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.370695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.370836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.371196] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.371352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.371449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.371696] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.371818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.372084] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 already deleted. [ 885.372084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.409133] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.409323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.409323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.409540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.409708] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.409806] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.409869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.410030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.410125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.410220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.410376] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.410467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.410525] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.410666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.410805] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.410893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.410951] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.411174] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.411253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.411331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.411418] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.763164] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.763421] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.763547] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.763829] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.763974] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.764141] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf not found, creating... [ 885.764398] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.764557] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.764672] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.764887] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.765033] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.765320] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.765468] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.765583] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.765787] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.765917] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.766122] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf is going to be created. [ 885.785576] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.785785] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.785886] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.786187] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.786411] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.786629] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.916017] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 650f4003-0da8-43a0-bfde-c7d15e589861: rpc.has_security_group_logging(os_id): False [ 885.942298] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.942492] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.942567] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.942787] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.942884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.943134] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.943237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.943323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.943495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.943574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.943757] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.943853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.943918] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.944077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.944153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.944329] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.944421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.944483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.944621] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.944693] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.944783] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 886.025657] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.025657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.025846] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.026220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.026546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.043522] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 886.527520] env[65413]: INFO networking_nsxv3.common.synchronization [req-7db107f0-f8de-4536-b664-12a919fbfffa req-6b5c5192-0556-4955-8c6e-dcca2de9cd3b service nova] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_rules [ 886.527702] env[65413]: INFO networking_nsxv3.common.synchronization [req-7db107f0-f8de-4536-b664-12a919fbfffa req-6b5c5192-0556-4955-8c6e-dcca2de9cd3b service nova] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 886.527869] env[65413]: INFO networking_nsxv3.common.synchronization [req-7db107f0-f8de-4536-b664-12a919fbfffa req-6b5c5192-0556-4955-8c6e-dcca2de9cd3b service nova] Enqueued Resource ID: fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf with Priority: HIGHEST for action port [ 886.531943] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_rules [ 886.531943] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 886.531943] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf with Priority: HIGHEST for action port [ 886.531943] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.531943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.531943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.531943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.531943] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.531943] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.531943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.531943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.531943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.532603] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.532735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.532805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.533062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.533180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.533291] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.534132] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.534452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.534452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.534698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.534804] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.550022] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: SUCCESS [ 886.550022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.550443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.550443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.550666] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.550666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.550915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.550915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.550915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.551129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.551129] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.857385] env[65413]: INFO networking_nsxv3.common.synchronization [req-0e34a753-2b0d-473d-8592-a59bba72d5e4 req-5c888dcc-bc86-4f94-8ebf-a54e853dba24 tempest-ServerAddressesNegativeTestJSON-201698025 tempest-ServerAddressesNegativeTestJSON-201698025-project-member] Enqueued Resource ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb with Priority: HIGHEST for action security_group_members [ 886.858196] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb with Priority: HIGHEST for action security_group_members [ 886.858664] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a0e7d88-1218-4171-a282-a951fc9c1dbb taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.859146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.859146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.859264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.859558] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.859719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.859841] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.860229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.860307] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.860388] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a0e7d88-1218-4171-a282-a951fc9c1dbb',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.044025] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.044025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.044025] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.044025] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf with status ACTIVE [ 887.044025] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.044025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.044025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.044025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.044025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.044025] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.044025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.044025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.044988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.045379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.045766] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.046009] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.046169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.046417] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.046606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.046780] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf is going to be updated. [ 887.054702] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.055177] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.055491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.055840] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.056169] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.056476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.056629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.056917] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.057143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.058275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.058548] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.058790] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.058947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.060402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.060402] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.060402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.060402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.060402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.060402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.060402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.060402] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.072953] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.073178] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.073178] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.073321] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.073446] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.073602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc7322dd-f75c-4ac2-b2b7-caa22d10c7bf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.292364] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-495 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.292560] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-495" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.292697] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-495" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.293080] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-495" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.293400] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.293595] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.293721] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.293954] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.294120] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.294347] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.294463] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.294568] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.294706] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.294836] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.294941] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.295126] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.316957] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.317159] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 887.319086] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.319086] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-495" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.319086] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-3458c6b6-2bdd-4994-959c-dc2064f9b427 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.319086] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-3458c6b6-2bdd-4994-959c-dc2064f9b427" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.319086] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-3458c6b6-2bdd-4994-959c-dc2064f9b427" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.319086] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-3458c6b6-2bdd-4994-959c-dc2064f9b427" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.319086] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3458c6b6-2bdd-4994-959c-dc2064f9b427',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.362943] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.363130] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.363183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.363388] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.363473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.363659] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.363754] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.363813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.363962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.364118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.364118] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb already deleted. [ 887.364188] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.390417] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-706 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.390692] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-706" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.390746] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-706" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.391083] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-706" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.391365] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.391524] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.391638] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.391846] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.391982] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.392226] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.392395] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 887.392515] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 887.392624] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 887.392736] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 887.392841] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 887.392967] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 887.413790] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 887.413973] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 887.414090] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 887.414347] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-706" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.414572] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-4372f370-5f35-4a30-a602-b8d135e376ad taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.414738] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-4372f370-5f35-4a30-a602-b8d135e376ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.414852] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-4372f370-5f35-4a30-a602-b8d135e376ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.415214] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-4372f370-5f35-4a30-a602-b8d135e376ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.415355] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4372f370-5f35-4a30-a602-b8d135e376ad',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.548857] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.562136] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e: rpc.has_security_group_logging(os_id): False [ 887.581628] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.581907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.581907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.582037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.582132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.582368] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.582490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.582605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.582767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.582848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.582980] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.583105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.583170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.583350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.583535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.583719] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.583805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.583866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.584067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.584148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.584234] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e is going to be created. [ 887.658444] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.658444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.658710] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.658757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.658990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.675053] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: IN_PROGRESS for 2s [ 887.823100] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.823100] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.823100] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.823449] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.823449] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.823667] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 3458c6b6-2bdd-4994-959c-dc2064f9b427 not found, creating... [ 887.823956] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.824141] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.824286] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.824529] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.824664] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.824947] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.825115] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.825234] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.825441] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.825569] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.825701] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 3458c6b6-2bdd-4994-959c-dc2064f9b427 is going to be created. [ 887.849094] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.849359] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.849465] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.849766] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.850022] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.850260] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-3458c6b6-2bdd-4994-959c-dc2064f9b427" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.918637] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.918881] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.919040] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.919386] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.919579] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.919743] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 4372f370-5f35-4a30-a602-b8d135e376ad not found, creating... [ 887.920035] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.920204] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.920350] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.920596] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.920736] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.921102] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.921284] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.921414] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.921659] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.921793] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.921950] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 4372f370-5f35-4a30-a602-b8d135e376ad is going to be created. [ 887.949169] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.949538] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.949538] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.949872] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.950153] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.950446] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-4372f370-5f35-4a30-a602-b8d135e376ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.051827] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.052354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.052354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.052525] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.052686] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.052850] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be created. [ 888.059299] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 888.059688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.088193] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.088421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.088421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.088610] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.088797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.102302] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: UNINITIALIZED for 2s [ 888.567268] env[65413]: INFO networking_nsxv3.common.synchronization [req-0e34a753-2b0d-473d-8592-a59bba72d5e4 req-f5d51499-070b-46af-b3a8-41bdbcc49abd service nova] Enqueued Resource ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb with Priority: HIGHEST for action security_group_rules [ 888.567268] env[65413]: INFO networking_nsxv3.common.synchronization [req-0e34a753-2b0d-473d-8592-a59bba72d5e4 req-f5d51499-070b-46af-b3a8-41bdbcc49abd service nova] Enqueued Resource ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb with Priority: HIGHEST for action security_group_members [ 888.567268] env[65413]: INFO networking_nsxv3.common.synchronization [req-0e34a753-2b0d-473d-8592-a59bba72d5e4 req-f5d51499-070b-46af-b3a8-41bdbcc49abd service nova] Enqueued Resource ID: 3458c6b6-2bdd-4994-959c-dc2064f9b427 with Priority: HIGHEST for action port [ 888.568137] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb with Priority: HIGHEST for action security_group_rules [ 888.568388] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb with Priority: HIGHEST for action security_group_members [ 888.568591] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3458c6b6-2bdd-4994-959c-dc2064f9b427 with Priority: HIGHEST for action port [ 888.568855] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a0e7d88-1218-4171-a282-a951fc9c1dbb taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.569022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.569145] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.569822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.569822] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a0e7d88-1218-4171-a282-a951fc9c1dbb',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.570678] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a0e7d88-1218-4171-a282-a951fc9c1dbb taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.571038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.571038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.571178] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.571337] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.571945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.571945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.571945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.571945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.572343] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a0e7d88-1218-4171-a282-a951fc9c1dbb',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.573043] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-3458c6b6-2bdd-4994-959c-dc2064f9b427 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.573317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3458c6b6-2bdd-4994-959c-dc2064f9b427" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.573317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3458c6b6-2bdd-4994-959c-dc2064f9b427" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.573698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3458c6b6-2bdd-4994-959c-dc2064f9b427" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.574017] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3458c6b6-2bdd-4994-959c-dc2064f9b427',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.696590] env[65413]: INFO networking_nsxv3.common.synchronization [req-7db107f0-f8de-4536-b664-12a919fbfffa req-f2932a83-53c7-4ba6-80be-9d4029ecbf42 service nova] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_rules [ 888.696708] env[65413]: INFO networking_nsxv3.common.synchronization [req-7db107f0-f8de-4536-b664-12a919fbfffa req-f2932a83-53c7-4ba6-80be-9d4029ecbf42 service nova] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 888.696842] env[65413]: INFO networking_nsxv3.common.synchronization [req-7db107f0-f8de-4536-b664-12a919fbfffa req-f2932a83-53c7-4ba6-80be-9d4029ecbf42 service nova] Enqueued Resource ID: 4372f370-5f35-4a30-a602-b8d135e376ad with Priority: HIGHEST for action port [ 888.697447] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_rules [ 888.697593] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 888.697715] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4372f370-5f35-4a30-a602-b8d135e376ad with Priority: HIGHEST for action port [ 888.697988] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.698143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.698416] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.698525] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.698804] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-4372f370-5f35-4a30-a602-b8d135e376ad taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.698937] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4372f370-5f35-4a30-a602-b8d135e376ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.699069] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4372f370-5f35-4a30-a602-b8d135e376ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.700387] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4372f370-5f35-4a30-a602-b8d135e376ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.700387] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4372f370-5f35-4a30-a602-b8d135e376ad',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.077530] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5a0e7d88-1218-4171-a282-a951fc9c1dbb',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.080670] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a0e7d88-1218-4171-a282-a951fc9c1dbb taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.080670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.080670] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3458c6b6-2bdd-4994-959c-dc2064f9b427 with status ACTIVE [ 889.080670] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.080670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.080670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.080670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.080670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.081405] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.082197] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.082247] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.082615] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.082615] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.083251] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.083251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.085137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.085949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.085949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.085949] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3458c6b6-2bdd-4994-959c-dc2064f9b427 is going to be updated. [ 889.119230] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.119657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.119657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.119657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.119788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.120528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3458c6b6-2bdd-4994-959c-dc2064f9b427" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.202933] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4372f370-5f35-4a30-a602-b8d135e376ad with status ACTIVE [ 889.203193] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.203514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.203660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.207228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.207228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.207228] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.207228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.207228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.207228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.207228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.207228] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.207228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.207228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.207228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.207228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.207228] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4372f370-5f35-4a30-a602-b8d135e376ad is going to be updated. [ 889.233812] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.233962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.234720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.234720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.234720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.234720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4372f370-5f35-4a30-a602-b8d135e376ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.587732] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5a0e7d88-1218-4171-a282-a951fc9c1dbb',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.680628] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-615 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.680900] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.681047] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.682823] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.682823] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.682823] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.682823] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.682823] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.682823] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.682823] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 889.683367] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 889.683367] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 889.683367] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 889.683367] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 889.683367] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 889.683575] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 889.687708] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: SUCCESS [ 889.688241] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.704444] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 889.704444] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 889.704444] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 889.704444] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-615" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.704691] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-5ad17924-c5e4-49df-a49e-331860dc1c77 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.704944] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-5ad17924-c5e4-49df-a49e-331860dc1c77" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.704944] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-5ad17924-c5e4-49df-a49e-331860dc1c77" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.705477] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-5ad17924-c5e4-49df-a49e-331860dc1c77" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.705581] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ad17924-c5e4-49df-a49e-331860dc1c77',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.093525] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.093911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.093911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.094130] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.094256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.094528] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb is going to be created. [ 890.118345] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 890.118580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.118792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.119140] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.119392] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.119538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.119603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.119788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.119869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.119978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.120142] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.121810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.121994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.122200] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.122357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.122467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.122550] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.122630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.122744] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.130169] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.130169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.130169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.130169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.130169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.139505] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb in Status: UNINITIALIZED for 2s [ 890.209151] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.209426] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.209564] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.209885] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.210067] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.210221] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 5ad17924-c5e4-49df-a49e-331860dc1c77 not found, creating... [ 890.210520] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.210695] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.210813] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.211210] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.211458] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.211780] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.211945] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.212543] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.212803] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.213030] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.213204] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 5ad17924-c5e4-49df-a49e-331860dc1c77 is going to be created. [ 890.236648] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.237056] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.237302] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.237738] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.238113] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.238478] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-5ad17924-c5e4-49df-a49e-331860dc1c77" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.622861] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.622861] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.626562] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.106244] env[65413]: INFO networking_nsxv3.common.synchronization [req-7db107f0-f8de-4536-b664-12a919fbfffa req-4cadc254-565e-429e-b078-6d2084e882ea service nova] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_rules [ 891.106527] env[65413]: INFO networking_nsxv3.common.synchronization [req-7db107f0-f8de-4536-b664-12a919fbfffa req-4cadc254-565e-429e-b078-6d2084e882ea service nova] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 891.106571] env[65413]: INFO networking_nsxv3.common.synchronization [req-7db107f0-f8de-4536-b664-12a919fbfffa req-4cadc254-565e-429e-b078-6d2084e882ea service nova] Enqueued Resource ID: 5ad17924-c5e4-49df-a49e-331860dc1c77 with Priority: HIGHEST for action port [ 891.107151] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_rules [ 891.107284] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 891.107422] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5ad17924-c5e4-49df-a49e-331860dc1c77 with Priority: HIGHEST for action port [ 891.107801] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.107881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.108319] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.108536] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.108890] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-5ad17924-c5e4-49df-a49e-331860dc1c77 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.109133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5ad17924-c5e4-49df-a49e-331860dc1c77" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.109255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5ad17924-c5e4-49df-a49e-331860dc1c77" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.109595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5ad17924-c5e4-49df-a49e-331860dc1c77" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.109687] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5ad17924-c5e4-49df-a49e-331860dc1c77',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.133636] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.612486] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5ad17924-c5e4-49df-a49e-331860dc1c77 with status ACTIVE [ 891.612690] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.613103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.613212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.613564] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.613990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.614141] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.614326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.614514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.614800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.614921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.618918] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.619054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.620145] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.620145] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.620145] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.620145] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5ad17924-c5e4-49df-a49e-331860dc1c77 is going to be updated. [ 891.638172] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.638429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.638429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.639459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.639459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.639459] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be updated. [ 891.686821] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.687182] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.687339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.688243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.688243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.688243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5ad17924-c5e4-49df-a49e-331860dc1c77" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.696977] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.697169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.697291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.697535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.697680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.709236] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 892.152318] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb in Status: SUCCESS [ 892.152756] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.152954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.153262] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.153482] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.153639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.153797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.155173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.155835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.155835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.156560] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5a0e7d88-1218-4171-a282-a951fc9c1dbb',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.661264] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a0e7d88-1218-4171-a282-a951fc9c1dbb taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.661264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.661264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.661264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.661264] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.661264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.661264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.661264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.661264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.661264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.661810] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a0e7d88-1218-4171-a282-a951fc9c1dbb taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.661810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.661810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.661924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.662225] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.662353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.662418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.662608] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.662734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.662858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.662981] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5a0e7d88-1218-4171-a282-a951fc9c1dbb',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.167830] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5a0e7d88-1218-4171-a282-a951fc9c1dbb: rpc.has_security_group_logging(os_id): False [ 893.187749] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.187749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.187749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.187749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.187749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.188245] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.188245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.188245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.188397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.188439] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.188677] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.188788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.188849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.188997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.189619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.189907] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.190151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.190240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.190508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.190589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.190677] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb is going to be created. [ 893.255243] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.255243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.255243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.255612] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.255797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.270416] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb in Status: IN_PROGRESS for 2s [ 893.591223] env[65413]: INFO networking_nsxv3.common.synchronization [req-59406fbf-ef17-4a11-88c3-6436c9dd03ac req-d222e426-65d3-410e-9906-836ab0f9ac04 tempest-ServersAdminTestJSON-1071948959 tempest-ServersAdminTestJSON-1071948959-project-member] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 893.591967] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGHEST for action security_group_members [ 893.592128] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.592624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.592744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.593080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.595485] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.595485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.595485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.595485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.595485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.595485] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.722282] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 893.722508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.722663] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.722905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.723117] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.723246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.723308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.723498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.723607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.723691] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.727953] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.727953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.727953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.727953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.727953] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.727953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.727953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.727953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.727953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.727953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.727953] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.727953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.727953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.728757] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.728757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.728757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.728757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.728757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.728757] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.052682] env[65413]: INFO networking_nsxv3.common.synchronization [req-74008f1d-05dc-48f3-8df3-b10249932754 req-43a7e669-b927-48c0-8aec-486f5be1f42a tempest-ServersNegativeTestMultiTenantJSON-48040970 tempest-ServersNegativeTestMultiTenantJSON-48040970-project-member] Enqueued Resource ID: 924c9188-b4e7-4597-a445-d583984b729f with Priority: HIGHEST for action security_group_members [ 894.054539] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 924c9188-b4e7-4597-a445-d583984b729f with Priority: HIGHEST for action security_group_members [ 894.054539] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-924c9188-b4e7-4597-a445-d583984b729f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.057175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.057175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.057175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.057175] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.057175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.057175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.057175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.057175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.057175] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('924c9188-b4e7-4597-a445-d583984b729f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.097999] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.097999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.097999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.097999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.126588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.126949] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.127151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.129019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.129019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.129019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.129019] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be updated. [ 894.173662] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.174018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.174123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.174372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.174575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.188240] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: IN_PROGRESS for 2s [ 894.234506] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.236043] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d92a9ea-1a70-4bff-aac7-578c2d7396f3: rpc.has_security_group_logging(os_id): False [ 894.259330] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.259515] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.259670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.259862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.259963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.260222] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.260329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.260381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.260552] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.260653] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.260852] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.260961] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.261415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.261738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.261862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.262148] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.262391] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.262391] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.262525] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.262600] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.262749] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be created. [ 894.349121] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.349121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.349121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.349121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.350078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.367528] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 894.561337] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.561553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.561553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.561757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.561816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.562018] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.562150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.562452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.562452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.562545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.562583] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 924c9188-b4e7-4597-a445-d583984b729f is going to be updated. [ 894.597156] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.597302] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.597372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.597580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.597722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.610851] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 924c9188-b4e7-4597-a445-d583984b729f in Status: IN_PROGRESS for 2s [ 894.737724] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.241247] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.242418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.242559] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.242734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.242826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.242924] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be updated. [ 895.278950] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.278950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.279202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.279841] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.279841] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.288614] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 895.289440] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb in Status: SUCCESS [ 895.289641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.199346] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 69363ac6-cdf1-4edb-9d06-998638037b3e in Status: SUCCESS [ 896.199836] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e deletion is rescheduled due to dependency. [ 896.199836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.382055] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 896.382391] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.382603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.382730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.382818] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.622715] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 924c9188-b4e7-4597-a445-d583984b729f in Status: SUCCESS [ 896.622902] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 924c9188-b4e7-4597-a445-d583984b729f deletion is rescheduled due to dependency. [ 896.623068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-924c9188-b4e7-4597-a445-d583984b729f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.892348] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.892348] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.301974] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 897.302254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.302530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.302994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.303109] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.303205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.303520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.303520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.303520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.303691] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.303691] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.806725] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.807045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.807130] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.807346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.808159] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.808159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.808159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.808159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.808159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.808159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.808390] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.808390] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.808468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.808657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.809915] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.809915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.809915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.809915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.809915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.809915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.809915] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.312173] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d92a9ea-1a70-4bff-aac7-578c2d7396f3: rpc.has_security_group_logging(os_id): False [ 898.333256] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.333411] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.333481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.333720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.333827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.334060] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.334165] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.334229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.334386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.334465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.334678] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.334777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.334837] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.334980] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.336044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.336297] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.336413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.336467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.336624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.336704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.336791] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be updated. [ 898.411303] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.411651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.411651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.411900] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.412104] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.436104] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 898.639965] env[65413]: INFO networking_nsxv3.common.synchronization [None req-8fa86329-89a7-4809-bd89-58881d31487f None None] Enqueued Resource ID: f1c6125e-fd03-46e9-9289-8653adc91d74 with Priority: HIGHEST for action port [ 898.640573] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1c6125e-fd03-46e9-9289-8653adc91d74 with Priority: HIGHEST for action port [ 898.640839] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-f1c6125e-fd03-46e9-9289-8653adc91d74 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.640957] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f1c6125e-fd03-46e9-9289-8653adc91d74" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.641185] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f1c6125e-fd03-46e9-9289-8653adc91d74" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.641335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f1c6125e-fd03-46e9-9289-8653adc91d74" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.641799] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f1c6125e-fd03-46e9-9289-8653adc91d74',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.144239] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f1c6125e-fd03-46e9-9289-8653adc91d74 [ 899.144655] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.144655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.144763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.144916] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.144998] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.145116] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f1c6125e-fd03-46e9-9289-8653adc91d74 already deleted. [ 899.145225] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f1c6125e-fd03-46e9-9289-8653adc91d74" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.942516] env[65413]: INFO networking_nsxv3.common.synchronization [None req-2aab0e1d-a2e7-43ce-9bfc-c1be1c8534e7 tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e with Priority: HIGHEST for action security_group_rules [ 899.943377] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e with Priority: HIGHEST for action security_group_rules [ 899.943838] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.944035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.944082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.944444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.944444] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380e8f44-e830-45ac-b5a4-5ad6b4d43d1e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.218407] env[65413]: INFO networking_nsxv3.common.synchronization [None req-476a2fd7-6ffe-4e8f-af41-5c528c659101 tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e with Priority: HIGHEST for action security_group_rules [ 900.219689] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e with Priority: HIGHEST for action security_group_rules [ 900.219689] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.219689] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.458068] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 900.459021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.459021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.459021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.459666] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.476280] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.476446] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.476489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.476760] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.476843] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.476965] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e already deleted. [ 900.477443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.477675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.477894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.478027] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380e8f44-e830-45ac-b5a4-5ad6b4d43d1e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.963748] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.964227] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.965239] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.965481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.965686] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.965958] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.965958] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.966107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.966153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.966326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.966427] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.002243] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.002614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.002758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.002983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.003088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.004160] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e already deleted. [ 901.004160] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.396027] env[65413]: INFO networking_nsxv3.common.synchronization [None req-2f2ba4f1-8ce2-4eef-8174-6957cc1bcb6c None None] Enqueued Resource ID: e5e0f070-2368-4d35-be2d-74a213beef05 with Priority: HIGHEST for action port [ 901.396027] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5e0f070-2368-4d35-be2d-74a213beef05 with Priority: HIGHEST for action port [ 901.397200] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5e0f070-2368-4d35-be2d-74a213beef05 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.397609] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5e0f070-2368-4d35-be2d-74a213beef05" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.397839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5e0f070-2368-4d35-be2d-74a213beef05" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.398868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5e0f070-2368-4d35-be2d-74a213beef05" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.398868] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5e0f070-2368-4d35-be2d-74a213beef05',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.474525] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.474717] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.474955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.475248] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.475505] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.477022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.477022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.477022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.477022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.477022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.477022] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.477022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.477022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.477022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.477022] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.477460] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.477722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.477943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.478052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.478175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.478300] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.902261] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5e0f070-2368-4d35-be2d-74a213beef05 [ 901.902261] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.902261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.902261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.902261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.902261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.902261] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5e0f070-2368-4d35-be2d-74a213beef05 already deleted. [ 901.902261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5e0f070-2368-4d35-be2d-74a213beef05" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.980784] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d92a9ea-1a70-4bff-aac7-578c2d7396f3: rpc.has_security_group_logging(os_id): False [ 902.002587] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.002812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.002889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.003132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.003223] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.003529] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.003529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.003650] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.003738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.003813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.003993] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.004223] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.004223] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.004310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.004354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.004546] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.005803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.005803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.005803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.005803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.005803] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be updated. [ 902.121595] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.124023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.124023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.124023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.124023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.160601] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 902.273306] env[65413]: INFO networking_nsxv3.common.synchronization [req-4c26b3dd-ed3c-4cad-9366-a306efe2606f req-4539a4ed-b8bc-4b70-a3c9-aba3a6040c52 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGHEST for action security_group_members [ 902.273648] env[65413]: INFO networking_nsxv3.common.synchronization [req-4c26b3dd-ed3c-4cad-9366-a306efe2606f req-4539a4ed-b8bc-4b70-a3c9-aba3a6040c52 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 902.273843] env[65413]: INFO networking_nsxv3.common.synchronization [req-4c26b3dd-ed3c-4cad-9366-a306efe2606f req-4539a4ed-b8bc-4b70-a3c9-aba3a6040c52 tempest-SecurityGroupsTestJSON-2145237333 tempest-SecurityGroupsTestJSON-2145237333-project-member] Enqueued Resource ID: 93ea813f-4897-4022-881c-ff28bf9f5462 with Priority: HIGHEST for action security_group_members [ 902.274736] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGHEST for action security_group_members [ 902.274966] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGHEST for action security_group_members [ 902.275189] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93ea813f-4897-4022-881c-ff28bf9f5462 with Priority: HIGHEST for action security_group_members [ 902.275677] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b12a08d1-d92e-480d-a458-27ffa6ee6832 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.275894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.276035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.276432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.276702] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.276863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.276959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.277628] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.279612] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.279794] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.281837] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.282659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.282870] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.283325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.283635] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.283815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.283938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.284222] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.284363] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.284607] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.288436] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-93ea813f-4897-4022-881c-ff28bf9f5462 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.288588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.288588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.288985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.288985] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.289154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.289215] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.289444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.289531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.289630] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('93ea813f-4897-4022-881c-ff28bf9f5462',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.749133] env[65413]: INFO networking_nsxv3.common.synchronization [None req-330314c0-f06c-47da-b762-622e756b783c None None] Enqueued Resource ID: 71b20f35-7b4e-4ed2-ad86-8fb22a2afa12 with Priority: HIGHEST for action port [ 902.750041] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71b20f35-7b4e-4ed2-ad86-8fb22a2afa12 with Priority: HIGHEST for action port [ 902.750135] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-71b20f35-7b4e-4ed2-ad86-8fb22a2afa12 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.750788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-71b20f35-7b4e-4ed2-ad86-8fb22a2afa12" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.750788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-71b20f35-7b4e-4ed2-ad86-8fb22a2afa12" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.751613] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-71b20f35-7b4e-4ed2-ad86-8fb22a2afa12" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.751727] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('71b20f35-7b4e-4ed2-ad86-8fb22a2afa12',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.791826] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.791826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.791826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.793342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.793342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.793601] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.793703] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.793792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.794021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.794097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.794257] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be updated. [ 902.796351] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.796351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.796351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.796351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.797413] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.797613] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.826920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.826920] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.826920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.827229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.827277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.827414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.827504] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 is going to be updated. [ 902.829938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.829938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.878037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.878437] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.878623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.879423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.879423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.879423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.879423] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ea813f-4897-4022-881c-ff28bf9f5462 is going to be updated. [ 902.892743] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.893222] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.893222] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.893222] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.893406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.895711] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.895948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.895948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.896462] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.896462] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.909355] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: IN_PROGRESS for 2s [ 902.910200] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: IN_PROGRESS for 2s [ 902.938208] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.938565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.938772] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.939183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.940845] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.952404] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ea813f-4897-4022-881c-ff28bf9f5462 in Status: IN_PROGRESS for 2s [ 903.255364] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 71b20f35-7b4e-4ed2-ad86-8fb22a2afa12 [ 903.255527] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.255644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.255705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.255958] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.256066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.256172] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:71b20f35-7b4e-4ed2-ad86-8fb22a2afa12 already deleted. [ 903.256257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-71b20f35-7b4e-4ed2-ad86-8fb22a2afa12" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.599221] env[65413]: INFO networking_nsxv3.common.synchronization [None req-1bf34250-6495-420b-939e-704399842022 tempest-ServersTestJSON-725515921 tempest-ServersTestJSON-725515921-project-member] Enqueued Resource ID: bc7b7d78-f994-42d1-964f-0485a67466cc with Priority: HIGHEST for action security_group_rules [ 903.599952] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7b7d78-f994-42d1-964f-0485a67466cc with Priority: HIGHEST for action security_group_rules [ 903.599952] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc7b7d78-f994-42d1-964f-0485a67466cc taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.599952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.599952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.600388] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.600388] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc7b7d78-f994-42d1-964f-0485a67466cc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.812169] env[65413]: INFO networking_nsxv3.common.synchronization [None req-c0e3fbb6-aa7d-41eb-8573-02ff4aae646e tempest-ServersTestJSON-725515921 tempest-ServersTestJSON-725515921-project-member] Enqueued Resource ID: bc7b7d78-f994-42d1-964f-0485a67466cc with Priority: HIGHEST for action security_group_rules [ 903.812169] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7b7d78-f994-42d1-964f-0485a67466cc with Priority: HIGHEST for action security_group_rules [ 903.812908] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc7b7d78-f994-42d1-964f-0485a67466cc taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.813156] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.127108] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.127240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.127312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.127534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.127632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.127725] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc7b7d78-f994-42d1-964f-0485a67466cc already deleted. [ 904.127813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.127978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.128151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.128246] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc7b7d78-f994-42d1-964f-0485a67466cc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.178608] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 904.179062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.656800] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.656800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.656800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.656800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.656800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.656800] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc7b7d78-f994-42d1-964f-0485a67466cc already deleted. [ 904.656800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.673400] env[65413]: INFO networking_nsxv3.common.synchronization [req-bbd0d732-e475-42f6-acc4-c787cfebbe98 req-c1ee165b-450d-4150-b230-71a2745ac7f3 tempest-ServerAddressesNegativeTestJSON-201698025 tempest-ServerAddressesNegativeTestJSON-201698025-project-member] Enqueued Resource ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb with Priority: HIGHEST for action security_group_members [ 904.677606] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb with Priority: HIGHEST for action security_group_members [ 904.677606] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5a0e7d88-1218-4171-a282-a951fc9c1dbb taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.677606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.677606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.677606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.677606] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.677606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.677606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.677606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.677606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.677606] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5a0e7d88-1218-4171-a282-a951fc9c1dbb',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.843970] env[65413]: INFO networking_nsxv3.common.synchronization [req-776daa6f-fbd3-403f-8279-4c266d83bc2f req-c96ad025-5a59-42ee-a142-033fb39e3098 tempest-DeleteServersTestJSON-2008533967 tempest-DeleteServersTestJSON-2008533967-project-member] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 904.844717] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 904.845043] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.845194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.845285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.845427] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.846030] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.846030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.846030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.846030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.846030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.846030] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.921723] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 in Status: SUCCESS [ 904.922229] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 deletion is rescheduled due to dependency. [ 904.922229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.925709] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 in Status: SUCCESS [ 904.925894] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 deletion is rescheduled due to dependency. [ 904.925973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.961730] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 93ea813f-4897-4022-881c-ff28bf9f5462 in Status: SUCCESS [ 904.961909] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 93ea813f-4897-4022-881c-ff28bf9f5462 deletion is rescheduled due to dependency. [ 904.962039] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-93ea813f-4897-4022-881c-ff28bf9f5462" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.181706] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.181706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.181706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.181706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.181706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.181706] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.181706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.181706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.181706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.181706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.181706] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb is going to be updated. [ 905.212715] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.212715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.212715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.212715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.212715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.216709] env[65413]: INFO networking_nsxv3.common.synchronization [None req-034e2c10-4cde-488c-93ef-f2919368f416 None None] Enqueued Resource ID: 74dfd099-ab77-4bad-b5a5-956766eaf6ad with Priority: HIGHEST for action port [ 905.219315] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 74dfd099-ab77-4bad-b5a5-956766eaf6ad with Priority: HIGHEST for action port [ 905.219844] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-74dfd099-ab77-4bad-b5a5-956766eaf6ad taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.220688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-74dfd099-ab77-4bad-b5a5-956766eaf6ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.220688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-74dfd099-ab77-4bad-b5a5-956766eaf6ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.220688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-74dfd099-ab77-4bad-b5a5-956766eaf6ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.220688] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('74dfd099-ab77-4bad-b5a5-956766eaf6ad',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.225489] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb in Status: IN_PROGRESS for 2s [ 905.278356] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-586 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.282151] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.282151] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.282151] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.282151] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.282151] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.282151] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.282151] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.282151] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.282151] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.282151] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.282151] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.282151] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.282151] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.282151] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.282151] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.315896] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.315896] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 905.315896] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.315896] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.315896] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-52f442ba-9b7b-45b5-b2d9-fedfcb14283f taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.315896] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-52f442ba-9b7b-45b5-b2d9-fedfcb14283f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.315896] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-52f442ba-9b7b-45b5-b2d9-fedfcb14283f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.316282] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-52f442ba-9b7b-45b5-b2d9-fedfcb14283f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.316316] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52f442ba-9b7b-45b5-b2d9-fedfcb14283f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.348594] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.348594] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.348594] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.349584] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.349584] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.349584] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.349752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.349805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.350257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.350257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.350626] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 905.391371] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.391569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.391655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.391821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.392098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.403035] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 905.725017] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 74dfd099-ab77-4bad-b5a5-956766eaf6ad [ 905.725315] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.725459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.725539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.725755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.725846] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.725940] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:74dfd099-ab77-4bad-b5a5-956766eaf6ad already deleted. [ 905.726316] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-74dfd099-ab77-4bad-b5a5-956766eaf6ad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.821537] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.821806] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.821873] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.822175] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.822372] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.822478] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 52f442ba-9b7b-45b5-b2d9-fedfcb14283f not found, creating... [ 905.822743] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.822900] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.823030] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.823369] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.823369] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.823680] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.823836] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.823951] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.826165] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.826314] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.826462] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 52f442ba-9b7b-45b5-b2d9-fedfcb14283f is going to be created. [ 905.848584] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.848952] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.848952] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.849299] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.849539] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.849775] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-52f442ba-9b7b-45b5-b2d9-fedfcb14283f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.379416] env[65413]: INFO networking_nsxv3.common.synchronization [None req-53cb4c41-40f2-4d98-bc54-d1b15c579bb5 None None] Enqueued Resource ID: 68e4c4e2-10ff-40d8-85cd-b7845075f872 with Priority: HIGHEST for action port [ 906.379572] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68e4c4e2-10ff-40d8-85cd-b7845075f872 with Priority: HIGHEST for action port [ 906.380515] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-68e4c4e2-10ff-40d8-85cd-b7845075f872 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.380848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68e4c4e2-10ff-40d8-85cd-b7845075f872" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.380979] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68e4c4e2-10ff-40d8-85cd-b7845075f872" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.381370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68e4c4e2-10ff-40d8-85cd-b7845075f872" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.381808] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68e4c4e2-10ff-40d8-85cd-b7845075f872',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.558028] env[65413]: INFO networking_nsxv3.common.synchronization [req-776daa6f-fbd3-403f-8279-4c266d83bc2f req-01a199f3-1c85-4abc-9398-1d7edababf46 service nova] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_rules [ 906.558028] env[65413]: INFO networking_nsxv3.common.synchronization [req-776daa6f-fbd3-403f-8279-4c266d83bc2f req-01a199f3-1c85-4abc-9398-1d7edababf46 service nova] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 906.558028] env[65413]: INFO networking_nsxv3.common.synchronization [req-776daa6f-fbd3-403f-8279-4c266d83bc2f req-01a199f3-1c85-4abc-9398-1d7edababf46 service nova] Enqueued Resource ID: 52f442ba-9b7b-45b5-b2d9-fedfcb14283f with Priority: HIGHEST for action port [ 906.559093] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_rules [ 906.559404] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 906.559583] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f442ba-9b7b-45b5-b2d9-fedfcb14283f with Priority: HIGHEST for action port [ 906.559966] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.560146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.560289] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.560567] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.560689] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.562469] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.562659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.562983] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-52f442ba-9b7b-45b5-b2d9-fedfcb14283f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.564494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52f442ba-9b7b-45b5-b2d9-fedfcb14283f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.564610] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52f442ba-9b7b-45b5-b2d9-fedfcb14283f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.565333] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52f442ba-9b7b-45b5-b2d9-fedfcb14283f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.565496] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52f442ba-9b7b-45b5-b2d9-fedfcb14283f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.884689] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68e4c4e2-10ff-40d8-85cd-b7845075f872 [ 906.886791] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.886791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.886791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.886791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.886791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.886791] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68e4c4e2-10ff-40d8-85cd-b7845075f872 already deleted. [ 906.887409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68e4c4e2-10ff-40d8-85cd-b7845075f872" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.037943] env[65413]: INFO networking_nsxv3.common.synchronization [req-6bc571c8-857a-4b5f-b075-ce804c60e9a6 req-6ab43055-82b8-4af0-96c0-8cf72441b5ef tempest-ServersTestMultiNic-1690690875 tempest-ServersTestMultiNic-1690690875-project-member] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 907.038526] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 907.038855] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.039773] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.040955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.041210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.041491] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.041621] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.041696] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.041857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.042392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.042392] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.068461] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.068461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.068712] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52f442ba-9b7b-45b5-b2d9-fedfcb14283f with status ACTIVE [ 907.068911] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.069046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.069110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.069371] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.069480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.069643] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.069953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.069953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.069953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.070063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.070362] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.070362] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.070503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.070560] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.070685] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.070745] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52f442ba-9b7b-45b5-b2d9-fedfcb14283f is going to be updated. [ 907.113625] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.113625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.113625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.113947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.114035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.114222] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52f442ba-9b7b-45b5-b2d9-fedfcb14283f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.242943] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb in Status: SUCCESS [ 907.242943] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb deletion is rescheduled due to dependency. [ 907.242943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.382533] env[65413]: INFO networking_nsxv3.common.synchronization [req-6bc571c8-857a-4b5f-b075-ce804c60e9a6 req-3e307aee-75fd-4e2f-88bb-3f316bb25755 tempest-ServersTestMultiNic-1690690875 tempest-ServersTestMultiNic-1690690875-project-member] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 907.383160] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 907.383664] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.383664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.424649] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 907.424805] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 deletion is rescheduled due to dependency. [ 907.424924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.425177] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.425468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.425650] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.425773] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.425840] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.426000] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.426094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.426190] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.548412] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.724574] env[65413]: INFO networking_nsxv3.common.synchronization [req-6bc571c8-857a-4b5f-b075-ce804c60e9a6 req-647a43f0-df06-41b4-ad6e-47a90d3e2596 tempest-ServersTestMultiNic-1690690875 tempest-ServersTestMultiNic-1690690875-project-member] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 907.725680] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 907.725680] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.725680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.910915] env[65413]: INFO networking_nsxv3.common.synchronization [None req-1e3b0794-bf5b-4a60-a42c-f88bcbd80ac4 tempest-ServerRescueNegativeTestJSON-135341842 tempest-ServerRescueNegativeTestJSON-135341842-project-member] Enqueued Resource ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 with Priority: HIGHEST for action security_group_rules [ 907.911689] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 with Priority: HIGHEST for action security_group_rules [ 907.912143] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.912392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.912507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.912802] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.912918] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.929868] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.045021] env[65413]: INFO networking_nsxv3.common.synchronization [None req-5e650a91-87ff-49b3-81cd-4f2e961a6b4f tempest-ServerRescueNegativeTestJSON-135341842 tempest-ServerRescueNegativeTestJSON-135341842-project-member] Enqueued Resource ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 with Priority: HIGHEST for action security_group_rules [ 908.047451] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 with Priority: HIGHEST for action security_group_rules [ 908.047451] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.047451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.053628] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.432345] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.437255] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.437474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.437474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.437692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.437782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.437873] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 already deleted. [ 908.438049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.438217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.438747] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.438867] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.556729] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.556729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.556729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.556729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.556729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.556729] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be updated. [ 908.589269] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.589269] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.589269] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.589416] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.589500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.601728] env[65413]: INFO networking_nsxv3.common.synchronization [None req-691dfca6-8e68-49de-8f23-2272f62afa32 None None] Enqueued Resource ID: c2d099be-e8a2-487c-9943-8cef1dd306d9 with Priority: HIGHEST for action port [ 908.602125] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c2d099be-e8a2-487c-9943-8cef1dd306d9 with Priority: HIGHEST for action port [ 908.602455] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-c2d099be-e8a2-487c-9943-8cef1dd306d9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.605788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c2d099be-e8a2-487c-9943-8cef1dd306d9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.606067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c2d099be-e8a2-487c-9943-8cef1dd306d9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.609110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c2d099be-e8a2-487c-9943-8cef1dd306d9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.609371] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c2d099be-e8a2-487c-9943-8cef1dd306d9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.613735] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 908.937867] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.938182] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.938182] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.938379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.938414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.938534] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 908.960496] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.961810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.961810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.961953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.962491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.962491] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 already deleted. [ 908.962491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.973058] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.973058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.973058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.973058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.973058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.985933] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 909.113213] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c2d099be-e8a2-487c-9943-8cef1dd306d9 [ 909.113431] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.113924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.113924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.113924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.113924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.114181] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c2d099be-e8a2-487c-9943-8cef1dd306d9 already deleted. [ 909.114181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c2d099be-e8a2-487c-9943-8cef1dd306d9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.309029] env[65413]: INFO networking_nsxv3.common.synchronization [None req-8e05ea19-ffea-484a-9581-c2ddc8ad9e54 tempest-ServersTestBootFromVolume-237210338 tempest-ServersTestBootFromVolume-237210338-project-member] Enqueued Resource ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 with Priority: HIGHEST for action security_group_rules [ 909.309029] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 with Priority: HIGHEST for action security_group_rules [ 909.309680] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.311067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.311067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.311067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.311067] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdd0e27d-c1b3-4c8e-bf7a-7837e9769380',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.448647] env[65413]: INFO networking_nsxv3.common.synchronization [None req-3e0086be-2ded-424a-8fe0-e3bc752022a9 tempest-ServersTestBootFromVolume-237210338 tempest-ServersTestBootFromVolume-237210338-project-member] Enqueued Resource ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 with Priority: HIGHEST for action security_group_rules [ 909.449267] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 with Priority: HIGHEST for action security_group_rules [ 909.449614] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.449720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.834326] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.834475] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.834577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.834751] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.834836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.834926] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 already deleted. [ 909.835012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.835172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.835325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.835400] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdd0e27d-c1b3-4c8e-bf7a-7837e9769380',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.365289] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.365690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.368063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.368063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.368063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.368063] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 already deleted. [ 910.368063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.629973] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 910.629973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.629973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.629973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.629973] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.629973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.629973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.629973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.629973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.629973] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.997301] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 910.997601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.997797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.998194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.998322] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.998463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.998549] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.998786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.998870] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.998960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.999075] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.135296] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.135507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.135604] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.135793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.135876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.136085] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.136176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.136235] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.136398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.136454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.136531] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be updated. [ 911.166771] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.166941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.166941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.167777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.167777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.180488] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 911.502405] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.502405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.502405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.503019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.503019] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.503205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.503263] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.503443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.503567] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.504025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.504489] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.504489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.504489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.505401] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.505401] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.505401] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.505401] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.505401] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.505749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.506734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.506734] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.723359] env[65413]: INFO networking_nsxv3.common.synchronization [req-54cc1d59-b01d-4786-a071-2f320af5303a req-747fc84f-858f-4907-95d0-4e3ee9082e03 tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 with Priority: HIGHEST for action security_group_members [ 911.723943] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 with Priority: HIGHEST for action security_group_members [ 911.724671] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.724671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.724671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.724825] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.724977] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.725253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.725389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.725567] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.725674] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.725814] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9b9c29e6-4adf-4695-9f0a-75daeb6daeb9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.009256] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d96dd8be-7e0f-4527-b6b4-1fd21b89c256: rpc.has_security_group_logging(os_id): False [ 912.031675] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.031675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.031932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.031932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.032098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.032342] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.032342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.032445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.032564] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.032642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.032822] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.032905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.032965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.033118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.033239] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.033359] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.033482] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.033554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.033651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.033736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.033811] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 912.118808] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.119053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.119053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.119330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.119516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.134932] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 912.228192] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.228400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.228483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.228727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.269974] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.270588] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.270588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.270756] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.270873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.274034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.274034] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 is going to be updated. [ 912.314056] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.314056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.314056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.314056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.314056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.329041] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 in Status: IN_PROGRESS for 2s [ 912.745497] env[65413]: INFO networking_nsxv3.common.synchronization [req-cacfbc0e-355c-448e-b70d-938fcd90e6e9 req-e700dd3a-c10c-4c51-a012-5da2507199f3 tempest-ServersNegativeTestJSON-1140018984 tempest-ServersNegativeTestJSON-1140018984-project-member] Enqueued Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_members [ 912.745497] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_members [ 912.745497] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.745497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.745497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.746251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.747075] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.747199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.747443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.747443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.747558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.747632] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.197968] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 913.198364] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 deletion is rescheduled due to dependency. [ 913.199619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.201035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.201035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.201035] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.201035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.201035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.201035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.201035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.201035] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.250907] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.439731] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-508 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.439989] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.440153] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.440472] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.440887] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.441064] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.442507] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.442658] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.442835] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.443097] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.443235] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 913.443366] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 913.443412] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 913.443749] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 913.443749] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 913.443858] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 913.465683] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 913.466161] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 913.466161] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 913.466278] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.466693] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-5c41a46e-155d-40f3-b2e5-4b7a595e1e2a taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.466948] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-5c41a46e-155d-40f3-b2e5-4b7a595e1e2a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.467224] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-5c41a46e-155d-40f3-b2e5-4b7a595e1e2a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.467606] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-5c41a46e-155d-40f3-b2e5-4b7a595e1e2a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.467778] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c41a46e-155d-40f3-b2e5-4b7a595e1e2a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.705277] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.705915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.708193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.708193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.708193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.708193] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.708193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.708193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.708193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.708193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.708193] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be updated. [ 913.739118] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.739118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.739118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.739118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.739488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.751779] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 913.754377] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.970238] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.970375] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.970433] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.970730] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.970947] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.971172] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 5c41a46e-155d-40f3-b2e5-4b7a595e1e2a not found, creating... [ 913.971510] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.971748] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.972408] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.972755] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.973022] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.973861] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.974982] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.975155] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.975488] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.975647] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.975809] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 5c41a46e-155d-40f3-b2e5-4b7a595e1e2a is going to be created. [ 913.997747] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.997747] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.997747] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.998818] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.998982] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.999159] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-5c41a46e-155d-40f3-b2e5-4b7a595e1e2a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.151738] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 914.152508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.259678] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.259992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.259992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.260476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.260476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.260552] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e is going to be updated. [ 914.295396] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.295396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.295396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.295905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.297432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.322284] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: IN_PROGRESS for 2s [ 914.342844] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 in Status: SUCCESS [ 914.343074] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9b9c29e6-4adf-4695-9f0a-75daeb6daeb9 deletion is rescheduled due to dependency. [ 914.343230] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9b9c29e6-4adf-4695-9f0a-75daeb6daeb9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.828268] env[65413]: INFO networking_nsxv3.common.synchronization [req-cacfbc0e-355c-448e-b70d-938fcd90e6e9 req-f1a1fc84-12f0-47b9-857f-d0d46d7a839b service nova] Enqueued Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_rules [ 914.828268] env[65413]: INFO networking_nsxv3.common.synchronization [req-cacfbc0e-355c-448e-b70d-938fcd90e6e9 req-f1a1fc84-12f0-47b9-857f-d0d46d7a839b service nova] Enqueued Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_members [ 914.828268] env[65413]: INFO networking_nsxv3.common.synchronization [req-cacfbc0e-355c-448e-b70d-938fcd90e6e9 req-f1a1fc84-12f0-47b9-857f-d0d46d7a839b service nova] Enqueued Resource ID: 5c41a46e-155d-40f3-b2e5-4b7a595e1e2a with Priority: HIGHEST for action port [ 914.829346] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_rules [ 914.829346] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_members [ 914.829346] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c41a46e-155d-40f3-b2e5-4b7a595e1e2a with Priority: HIGHEST for action port [ 914.829346] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.829575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.829575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.829714] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.829796] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.830900] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.830960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.831139] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c41a46e-155d-40f3-b2e5-4b7a595e1e2a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.831769] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c41a46e-155d-40f3-b2e5-4b7a595e1e2a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.831769] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c41a46e-155d-40f3-b2e5-4b7a595e1e2a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.831769] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c41a46e-155d-40f3-b2e5-4b7a595e1e2a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.831769] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c41a46e-155d-40f3-b2e5-4b7a595e1e2a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.334138] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c41a46e-155d-40f3-b2e5-4b7a595e1e2a with status ACTIVE [ 915.334382] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.334752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.334833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.335048] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.335136] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.335313] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.335413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.335471] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.335630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.335708] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.335889] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.335984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.336055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.336197] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.336278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.336363] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c41a46e-155d-40f3-b2e5-4b7a595e1e2a is going to be updated. [ 915.338398] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.338513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.374583] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.374825] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.374825] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.375094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.375329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.375329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c41a46e-155d-40f3-b2e5-4b7a595e1e2a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.762987] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 915.763133] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 deletion is rescheduled due to dependency. [ 915.763251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.352483] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: SUCCESS [ 916.352483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.352483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.352483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.352793] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.352793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.352876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.353722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.353722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.353722] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.856857] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.360879] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.863936] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.864194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.864194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.864390] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.864479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.864574] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e is going to be updated. [ 917.892946] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.893160] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.893304] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.893422] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.893563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.903934] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: IN_PROGRESS for 2s [ 919.219954] env[65413]: INFO networking_nsxv3.common.synchronization [req-eeff2a2d-e5c1-4ea8-b792-a61dfc08cee8 req-01ecf43e-38ee-41be-bb01-27add1b79632 tempest-ServerDiskConfigTestJSON-938124936 tempest-ServerDiskConfigTestJSON-938124936-project-member] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 919.220632] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 919.221246] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.221425] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.221425] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.221690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.222166] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.222166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.222166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.222341] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.222341] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.222451] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.608368] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.608599] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.608901] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.609220] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.609554] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.609748] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.609867] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.610141] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.610314] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.610527] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 919.610839] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 919.610839] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 919.610839] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 919.610942] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 919.611051] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 919.611184] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 919.636857] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 919.637116] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 919.637233] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 919.637408] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.637740] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-23e96b6f-95ac-452b-a577-217d0f8ae738 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.638057] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-23e96b6f-95ac-452b-a577-217d0f8ae738" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.638161] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-23e96b6f-95ac-452b-a577-217d0f8ae738" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.639941] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-23e96b6f-95ac-452b-a577-217d0f8ae738" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.639941] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23e96b6f-95ac-452b-a577-217d0f8ae738',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.724968] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.725250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.725346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.725666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.725771] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.726030] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.726176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.726418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.726486] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.726557] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.726652] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 already deleted. [ 919.726740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.914708] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: SUCCESS [ 919.914932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.915494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.915494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.915678] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.915853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.915953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.916183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.916292] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.916353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.916446] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.141668] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.141926] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.142066] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.142386] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.142819] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.142819] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 23e96b6f-95ac-452b-a577-217d0f8ae738 not found, creating... [ 920.143019] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.143208] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.143304] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.143537] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.143707] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.144017] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.144177] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.144322] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.144533] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.144630] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.144772] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 23e96b6f-95ac-452b-a577-217d0f8ae738 is going to be created. [ 920.168584] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.169681] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.169681] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.169681] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.169936] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.171766] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-23e96b6f-95ac-452b-a577-217d0f8ae738" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.418750] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.419045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.419045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.419214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.419375] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.419480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.419544] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.419715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.419804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.419901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.420096] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.420193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.420250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.420391] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.420528] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.420619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.420752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.420917] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.420993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.421086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.421180] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.839051] env[65413]: INFO networking_nsxv3.common.synchronization [req-5d7b44a2-a782-46df-a27d-30b20b6f8d6b req-3e520663-0d33-47e7-bb4c-16a6d0a66eec tempest-ServerActionsTestJSON-1087044681 tempest-ServerActionsTestJSON-1087044681-project-member] Enqueued Resource ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 with Priority: HIGHEST for action security_group_members [ 920.839820] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 with Priority: HIGHEST for action security_group_members [ 920.840245] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7c33cf7-e412-4969-a4ca-045fd79b0e48 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.840397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.840467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.840687] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.840863] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.841456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.841456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.841456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.841456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.841456] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7c33cf7-e412-4969-a4ca-045fd79b0e48',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.886705] env[65413]: INFO networking_nsxv3.common.synchronization [req-eeff2a2d-e5c1-4ea8-b792-a61dfc08cee8 req-b286fb6e-24d7-4dc7-9ca7-9731accc8efa service nova] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_rules [ 920.886882] env[65413]: INFO networking_nsxv3.common.synchronization [req-eeff2a2d-e5c1-4ea8-b792-a61dfc08cee8 req-b286fb6e-24d7-4dc7-9ca7-9731accc8efa service nova] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 920.887039] env[65413]: INFO networking_nsxv3.common.synchronization [req-eeff2a2d-e5c1-4ea8-b792-a61dfc08cee8 req-b286fb6e-24d7-4dc7-9ca7-9731accc8efa service nova] Enqueued Resource ID: 23e96b6f-95ac-452b-a577-217d0f8ae738 with Priority: HIGHEST for action port [ 920.887543] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_rules [ 920.887676] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 920.887775] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23e96b6f-95ac-452b-a577-217d0f8ae738 with Priority: HIGHEST for action port [ 920.888321] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.888466] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.888536] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.888872] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.888910] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.889841] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.889959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.890037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.890222] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.890371] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.890459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.890519] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.890659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.890743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.890828] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.891914] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-23e96b6f-95ac-452b-a577-217d0f8ae738 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.892038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23e96b6f-95ac-452b-a577-217d0f8ae738" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.892090] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23e96b6f-95ac-452b-a577-217d0f8ae738" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.892249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23e96b6f-95ac-452b-a577-217d0f8ae738" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.892328] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23e96b6f-95ac-452b-a577-217d0f8ae738',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.923901] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e: rpc.has_security_group_logging(os_id): False [ 920.947326] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.947574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.947670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.948104] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.948142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.948469] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.948627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.948740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.949293] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.949603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.949902] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.950068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.950166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.950700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.950860] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.951139] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.951290] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.951443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.951660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.951782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.951907] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e is going to be updated. [ 921.023022] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.023022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.023022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.023022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.023022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.046359] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: IN_PROGRESS for 2s [ 921.346032] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.346032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.346032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.346032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.390684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.391983] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.391983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.391983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.391983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.391983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.391983] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 is going to be updated. [ 921.393703] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.396052] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.396052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.396052] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 23e96b6f-95ac-452b-a577-217d0f8ae738 with status ACTIVE [ 921.396052] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.396052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.396052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.396052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.396052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.396052] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.396052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.396459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.396459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.396459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.396628] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.396724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.396785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.396934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.397083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.397185] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 23e96b6f-95ac-452b-a577-217d0f8ae738 is going to be updated. [ 921.429121] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.429495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.429495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.429743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.429880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.430052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23e96b6f-95ac-452b-a577-217d0f8ae738" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.564885] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.565128] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.565215] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.569238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.569238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.577393] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 in Status: IN_PROGRESS for 2s [ 921.902644] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.244773] env[65413]: INFO networking_nsxv3.common.synchronization [req-0d20695e-f786-42ff-8599-7e4242ccfb29 req-543241af-8c7a-431f-958c-b16f3975f331 tempest-DeleteServersTestJSON-2008533967 tempest-DeleteServersTestJSON-2008533967-project-member] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 922.248033] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 922.248033] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.248033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.248273] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.248273] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.248571] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.248667] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.248667] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.248818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.248901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.249109] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.405815] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.405815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.405815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.406187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.406295] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.406371] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be created. [ 922.433225] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.433540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.433540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.434071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.434071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.448645] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: UNINITIALIZED for 2s [ 922.750744] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.750901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.750946] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.751278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.751278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.753886] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.753886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.753886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.753886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.753886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.753886] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 922.797547] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.797731] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.797804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.799945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.800118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.813660] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 923.063020] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: SUCCESS [ 923.063020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.592921] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 in Status: SUCCESS [ 923.593746] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 deletion is rescheduled due to dependency. [ 923.593746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.735448] env[65413]: INFO networking_nsxv3.common.synchronization [req-072dd42f-e1b6-43cf-a844-f0f929862521 req-f61404c2-d0d3-470e-b28f-4bec8b65d43d tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e with Priority: HIGHEST for action security_group_members [ 923.735999] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e with Priority: HIGHEST for action security_group_members [ 923.737458] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.737595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.737672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.737990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.739257] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.739257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.739257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.739257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.739257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.739257] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('380e8f44-e830-45ac-b5a4-5ad6b4d43d1e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.238424] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.238646] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.238743] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.243753] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.244813] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.245098] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.245432] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.245695] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.245847] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.246089] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.246434] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 924.246554] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 924.246664] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 924.246772] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 924.246914] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 924.249057] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 924.251330] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.251469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.251533] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.251732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.251817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.252022] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.252199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.252199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.252319] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.252392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.252476] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e already deleted. [ 924.252554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.273076] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 924.273346] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 924.273552] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 924.273737] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.274123] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-90fa80de-51c3-4c3c-aea9-184bb2cb0e75 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.274329] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-90fa80de-51c3-4c3c-aea9-184bb2cb0e75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.274456] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-90fa80de-51c3-4c3c-aea9-184bb2cb0e75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.274831] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-90fa80de-51c3-4c3c-aea9-184bb2cb0e75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.274988] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90fa80de-51c3-4c3c-aea9-184bb2cb0e75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.460771] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 924.460991] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.461170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.461401] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.461622] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.461746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.461813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.461971] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.462062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.462146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.462236] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.778909] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.778909] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.778909] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.779535] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.779535] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.779722] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 90fa80de-51c3-4c3c-aea9-184bb2cb0e75 not found, creating... [ 924.780389] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.780389] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.780389] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.780877] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.780877] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.781294] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.781294] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.782162] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.782692] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.782692] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.782869] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 90fa80de-51c3-4c3c-aea9-184bb2cb0e75 is going to be created. [ 924.812797] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.813056] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.813192] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.813659] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.813996] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.814281] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-90fa80de-51c3-4c3c-aea9-184bb2cb0e75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.824325] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 924.824515] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 deletion is rescheduled due to dependency. [ 924.824644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.965344] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.965617] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.965677] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.968037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.968037] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.968037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.968037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.968037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.968037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.968037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.968037] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.968037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.968037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.968037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.968037] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.968588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.968588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.968588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.968683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.968769] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.968904] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.474643] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 579e1066-bea4-4954-a499-fb0ae75b5375: rpc.has_security_group_logging(os_id): False [ 925.497520] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.497757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.497757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.497919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.498040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.498252] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.498683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.498683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.498683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.498683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.500023] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.500023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.500023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.500023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.500023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.500023] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.500023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.500023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.500023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.501513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.501513] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be created. [ 925.550222] env[65413]: INFO networking_nsxv3.common.synchronization [req-072dd42f-e1b6-43cf-a844-f0f929862521 req-7b723220-bfd0-46e9-b633-d54459de1843 service nova] Enqueued Resource ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e with Priority: HIGHEST for action security_group_rules [ 925.550440] env[65413]: INFO networking_nsxv3.common.synchronization [req-072dd42f-e1b6-43cf-a844-f0f929862521 req-7b723220-bfd0-46e9-b633-d54459de1843 service nova] Enqueued Resource ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e with Priority: HIGHEST for action security_group_members [ 925.550597] env[65413]: INFO networking_nsxv3.common.synchronization [req-072dd42f-e1b6-43cf-a844-f0f929862521 req-7b723220-bfd0-46e9-b633-d54459de1843 service nova] Enqueued Resource ID: 90fa80de-51c3-4c3c-aea9-184bb2cb0e75 with Priority: HIGHEST for action port [ 925.555771] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e with Priority: HIGHEST for action security_group_rules [ 925.555934] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e with Priority: HIGHEST for action security_group_members [ 925.556127] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fa80de-51c3-4c3c-aea9-184bb2cb0e75 with Priority: HIGHEST for action port [ 925.556511] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.556644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.556714] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.556931] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.557356] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380e8f44-e830-45ac-b5a4-5ad6b4d43d1e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.558634] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.558634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.558634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.559135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.559135] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.559135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.559135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.559331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.559365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.559540] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('380e8f44-e830-45ac-b5a4-5ad6b4d43d1e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.562229] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-90fa80de-51c3-4c3c-aea9-184bb2cb0e75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.562578] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-90fa80de-51c3-4c3c-aea9-184bb2cb0e75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.562578] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-90fa80de-51c3-4c3c-aea9-184bb2cb0e75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.562720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-90fa80de-51c3-4c3c-aea9-184bb2cb0e75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.562720] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('90fa80de-51c3-4c3c-aea9-184bb2cb0e75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.573275] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.573275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.573275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.573468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.573767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.587942] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 926.063038] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('380e8f44-e830-45ac-b5a4-5ad6b4d43d1e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.064486] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.064622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.064785] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 90fa80de-51c3-4c3c-aea9-184bb2cb0e75 with status ACTIVE [ 926.064963] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.065086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.066131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.066131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.066131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.066131] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.066131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.066131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.066693] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.066823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.067049] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.067157] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.067220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.067368] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.067444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.067528] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 90fa80de-51c3-4c3c-aea9-184bb2cb0e75 is going to be updated. [ 926.093630] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.093881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.093943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.094272] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.094364] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.094562] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-90fa80de-51c3-4c3c-aea9-184bb2cb0e75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.571319] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('380e8f44-e830-45ac-b5a4-5ad6b4d43d1e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.626568] env[65413]: INFO networking_nsxv3.common.synchronization [None req-25779432-2d6a-4d7c-964e-14f585414956 None None] Enqueued Resource ID: db71e012-3872-49ba-a696-04d68188a111 with Priority: HIGHEST for action port [ 926.626568] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db71e012-3872-49ba-a696-04d68188a111 with Priority: HIGHEST for action port [ 926.626568] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-db71e012-3872-49ba-a696-04d68188a111 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.626568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db71e012-3872-49ba-a696-04d68188a111" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.626568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db71e012-3872-49ba-a696-04d68188a111" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.627170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db71e012-3872-49ba-a696-04d68188a111" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.627170] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db71e012-3872-49ba-a696-04d68188a111',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.057716] env[65413]: INFO networking_nsxv3.common.synchronization [req-1844cca3-138c-4358-bd85-ce5a9f9dabe0 req-bf54e322-e9f5-47c0-a6f2-6af440c201be tempest-ServersNegativeTestJSON-1140018984 tempest-ServersNegativeTestJSON-1140018984-project-member] Enqueued Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_members [ 927.058134] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_members [ 927.058451] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.059058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.059058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.059058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.060040] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.060137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.060184] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.060410] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.060532] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.060635] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.073852] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.073852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.073852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.073852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.074320] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.074320] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e is going to be created. [ 927.119077] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.119373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.119373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.119618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.119783] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.128933] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db71e012-3872-49ba-a696-04d68188a111 [ 927.129179] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.129297] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.129400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.129580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.129658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.129751] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db71e012-3872-49ba-a696-04d68188a111 already deleted. [ 927.129820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db71e012-3872-49ba-a696-04d68188a111" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.136946] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e in Status: UNINITIALIZED for 2s [ 927.565058] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.602469] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 927.602763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.068700] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.574623] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.574958] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.574958] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.575061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.575244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.575512] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e is going to be updated. [ 928.605800] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.606125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.606125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.606244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.606316] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.619879] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: IN_PROGRESS for 2s [ 929.140079] env[65413]: INFO networking_nsxv3.common.synchronization [None req-418eb42c-1236-4399-a35d-ce7199629c80 None None] Enqueued Resource ID: 85d05b38-7a41-42a0-b2ac-cea646a60fa2 with Priority: HIGHEST for action port [ 929.140756] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85d05b38-7a41-42a0-b2ac-cea646a60fa2 with Priority: HIGHEST for action port [ 929.141684] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-85d05b38-7a41-42a0-b2ac-cea646a60fa2 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.143172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85d05b38-7a41-42a0-b2ac-cea646a60fa2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.143172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85d05b38-7a41-42a0-b2ac-cea646a60fa2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.143172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85d05b38-7a41-42a0-b2ac-cea646a60fa2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.143172] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85d05b38-7a41-42a0-b2ac-cea646a60fa2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.150082] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e in Status: SUCCESS [ 929.150292] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.153526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.153526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.153949] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.154367] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.154367] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.154367] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.154506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.154689] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.155057] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('380e8f44-e830-45ac-b5a4-5ad6b4d43d1e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.648358] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85d05b38-7a41-42a0-b2ac-cea646a60fa2 [ 929.648736] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.648736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.649164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.649164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.649164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.649247] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85d05b38-7a41-42a0-b2ac-cea646a60fa2 already deleted. [ 929.649554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85d05b38-7a41-42a0-b2ac-cea646a60fa2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.658480] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('380e8f44-e830-45ac-b5a4-5ad6b4d43d1e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.113463] env[65413]: INFO networking_nsxv3.common.synchronization [req-4ac66700-4e5c-43aa-9608-a17c1b6af1e3 req-8759ceca-f50b-46cc-998a-51b1b2fe5e50 tempest-ServersTestJSON-725515921 tempest-ServersTestJSON-725515921-project-member] Enqueued Resource ID: bc7b7d78-f994-42d1-964f-0485a67466cc with Priority: HIGHEST for action security_group_members [ 930.113862] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7b7d78-f994-42d1-964f-0485a67466cc with Priority: HIGHEST for action security_group_members [ 930.116579] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc7b7d78-f994-42d1-964f-0485a67466cc taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.117783] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.117884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.118173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.118346] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.118449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.118572] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.118670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.118758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.118882] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc7b7d78-f994-42d1-964f-0485a67466cc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.163616] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e: rpc.has_security_group_logging(os_id): False [ 930.184374] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.184546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.184546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.184750] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.184842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.185413] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.185413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.185413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.185413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.185603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.185603] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e is going to be created. [ 930.247853] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.247990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.248083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.248350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.248534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.267025] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e in Status: IN_PROGRESS for 2s [ 930.533292] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-449 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.533488] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-449" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.533656] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-449" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.533896] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-449" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.534134] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.534329] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.534407] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.534606] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.534747] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.535169] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.535169] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 930.535289] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 930.535320] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 930.535416] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 930.535514] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 930.536053] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 930.560926] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 930.561066] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 930.561212] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 930.561393] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-449" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.561836] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-3fd7297d-b185-4bda-9107-16c0aeefc457 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.562090] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-3fd7297d-b185-4bda-9107-16c0aeefc457" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.562959] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-3fd7297d-b185-4bda-9107-16c0aeefc457" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.562959] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-3fd7297d-b185-4bda-9107-16c0aeefc457" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.562959] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fd7297d-b185-4bda-9107-16c0aeefc457',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.622632] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.623940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.624027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.624266] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.624360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.625059] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.625059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.625059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.625059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.625059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.625059] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc7b7d78-f994-42d1-964f-0485a67466cc already deleted. [ 930.625347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.636707] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: SUCCESS [ 930.636768] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.066232] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.066629] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.066773] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.067116] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.067286] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.067447] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 3fd7297d-b185-4bda-9107-16c0aeefc457 not found, creating... [ 931.067757] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.067937] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.068074] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.068333] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.068528] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.068824] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.069015] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.069160] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.069399] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.069541] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.069696] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 3fd7297d-b185-4bda-9107-16c0aeefc457 is going to be created. [ 931.093867] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.094108] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.094243] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.094517] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.094776] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.095017] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-3fd7297d-b185-4bda-9107-16c0aeefc457" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.851819] env[65413]: INFO networking_nsxv3.common.synchronization [req-4ac66700-4e5c-43aa-9608-a17c1b6af1e3 req-0857373a-b2c8-4eaa-b707-b22dec0f7161 service nova] Enqueued Resource ID: bc7b7d78-f994-42d1-964f-0485a67466cc with Priority: HIGHEST for action security_group_rules [ 931.852084] env[65413]: INFO networking_nsxv3.common.synchronization [req-4ac66700-4e5c-43aa-9608-a17c1b6af1e3 req-0857373a-b2c8-4eaa-b707-b22dec0f7161 service nova] Enqueued Resource ID: bc7b7d78-f994-42d1-964f-0485a67466cc with Priority: HIGHEST for action security_group_members [ 931.852256] env[65413]: INFO networking_nsxv3.common.synchronization [req-4ac66700-4e5c-43aa-9608-a17c1b6af1e3 req-0857373a-b2c8-4eaa-b707-b22dec0f7161 service nova] Enqueued Resource ID: 3fd7297d-b185-4bda-9107-16c0aeefc457 with Priority: HIGHEST for action port [ 931.852874] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7b7d78-f994-42d1-964f-0485a67466cc with Priority: HIGHEST for action security_group_rules [ 931.853016] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7b7d78-f994-42d1-964f-0485a67466cc with Priority: HIGHEST for action security_group_members [ 931.853587] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fd7297d-b185-4bda-9107-16c0aeefc457 with Priority: HIGHEST for action port [ 931.853937] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc7b7d78-f994-42d1-964f-0485a67466cc taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.854137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.854232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.854479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.854605] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc7b7d78-f994-42d1-964f-0485a67466cc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.855639] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc7b7d78-f994-42d1-964f-0485a67466cc taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.855791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.855889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.856190] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.857116] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.857224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.857446] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.857446] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.857746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.857983] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc7b7d78-f994-42d1-964f-0485a67466cc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.859866] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fd7297d-b185-4bda-9107-16c0aeefc457 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.859973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fd7297d-b185-4bda-9107-16c0aeefc457" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.860073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fd7297d-b185-4bda-9107-16c0aeefc457" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.860835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fd7297d-b185-4bda-9107-16c0aeefc457" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.860901] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fd7297d-b185-4bda-9107-16c0aeefc457',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.280011] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e in Status: SUCCESS [ 932.280352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.363065] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc7b7d78-f994-42d1-964f-0485a67466cc taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.363352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.363593] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bc7b7d78-f994-42d1-964f-0485a67466cc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.365040] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fd7297d-b185-4bda-9107-16c0aeefc457 with status ACTIVE [ 932.365863] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.366013] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.366083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.366291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.366379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.366556] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.366658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.366718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.366882] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.366963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.368574] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.368730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.368827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.369075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.369621] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.369769] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fd7297d-b185-4bda-9107-16c0aeefc457 is going to be updated. [ 932.395198] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.395337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.395411] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.395621] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.395759] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.395911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fd7297d-b185-4bda-9107-16c0aeefc457" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.692746] env[65413]: INFO networking_nsxv3.common.synchronization [None req-0ef3af90-881f-4b7f-bce5-f45a483a24f7 tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 with Priority: HIGHEST for action security_group_rules [ 932.692746] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 with Priority: HIGHEST for action security_group_rules [ 932.692746] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.692746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.692746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.692746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.692746] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e66f37bc-ef47-4d76-937b-4d1c38a4ffe7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.791992] env[65413]: INFO networking_nsxv3.common.synchronization [None req-7cba55e0-d3e4-4b49-b171-62dd4c2cf59d tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 with Priority: HIGHEST for action security_group_rules [ 932.792942] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 with Priority: HIGHEST for action security_group_rules [ 932.793357] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.793487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.874148] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bc7b7d78-f994-42d1-964f-0485a67466cc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.220489] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.220489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.220489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.220489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.220489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.220489] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 already deleted. [ 933.220489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.220489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.220489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.220489] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e66f37bc-ef47-4d76-937b-4d1c38a4ffe7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.375944] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.376261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.376261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.376404] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.376489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.376592] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc7b7d78-f994-42d1-964f-0485a67466cc is going to be created. [ 933.404297] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.404449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.404520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.404731] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.404887] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.416911] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc7b7d78-f994-42d1-964f-0485a67466cc in Status: UNINITIALIZED for 2s [ 933.743987] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.743987] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.744170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.744425] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.744425] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.744527] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 already deleted. [ 933.744527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.489097] env[65413]: INFO networking_nsxv3.common.synchronization [req-8b2b3ea7-4981-4d5e-91c6-4d56bb36c8fc req-f5cbf5c5-cf18-4f02-9327-737ba9f4b16e tempest-ServerRescueNegativeTestJSON-135341842 tempest-ServerRescueNegativeTestJSON-135341842-project-member] Enqueued Resource ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 with Priority: HIGHEST for action security_group_members [ 934.489673] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 with Priority: HIGHEST for action security_group_members [ 934.489982] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.490205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.490269] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.490727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.490900] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.491012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.491078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.491240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.491324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.491414] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.820749] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-603 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.822120] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-603" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.822120] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-603" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.822120] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-603" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.822120] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.822746] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.822980] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.823321] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.823566] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.823972] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.824194] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.824884] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.825299] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.825865] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.826113] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.826890] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.846918] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.846918] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 934.848373] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.848373] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-603" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.848373] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-15ffc214-b1d2-4e69-8a67-f9c54cc59db3 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.848373] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-15ffc214-b1d2-4e69-8a67-f9c54cc59db3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.848373] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-15ffc214-b1d2-4e69-8a67-f9c54cc59db3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.848709] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-15ffc214-b1d2-4e69-8a67-f9c54cc59db3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.848709] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15ffc214-b1d2-4e69-8a67-f9c54cc59db3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.994214] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.994429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.994528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.994767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.994853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.995070] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.995179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.995240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.995396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.995472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.995558] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 already deleted. [ 934.995635] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.350864] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.353035] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.353035] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.353035] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.353035] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.353035] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 15ffc214-b1d2-4e69-8a67-f9c54cc59db3 not found, creating... [ 935.353035] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.353035] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.353035] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.353035] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.357036] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.357036] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.357036] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.357036] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.357036] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.357036] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.357036] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 15ffc214-b1d2-4e69-8a67-f9c54cc59db3 is going to be created. [ 935.379593] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.379816] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.379940] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.380247] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.380533] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.380701] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-15ffc214-b1d2-4e69-8a67-f9c54cc59db3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.432456] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc7b7d78-f994-42d1-964f-0485a67466cc in Status: SUCCESS [ 935.432601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.432724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.433017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.433227] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.433347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.433416] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.433580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.433660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.433744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.433835] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bc7b7d78-f994-42d1-964f-0485a67466cc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.936643] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bc7b7d78-f994-42d1-964f-0485a67466cc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.123471] env[65413]: INFO networking_nsxv3.common.synchronization [req-8b2b3ea7-4981-4d5e-91c6-4d56bb36c8fc req-f598e386-c42e-4354-8910-93875f5174de service nova] Enqueued Resource ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 with Priority: HIGHEST for action security_group_rules [ 936.123661] env[65413]: INFO networking_nsxv3.common.synchronization [req-8b2b3ea7-4981-4d5e-91c6-4d56bb36c8fc req-f598e386-c42e-4354-8910-93875f5174de service nova] Enqueued Resource ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 with Priority: HIGHEST for action security_group_members [ 936.123794] env[65413]: INFO networking_nsxv3.common.synchronization [req-8b2b3ea7-4981-4d5e-91c6-4d56bb36c8fc req-f598e386-c42e-4354-8910-93875f5174de service nova] Enqueued Resource ID: 15ffc214-b1d2-4e69-8a67-f9c54cc59db3 with Priority: HIGHEST for action port [ 936.124325] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 with Priority: HIGHEST for action security_group_rules [ 936.124514] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 with Priority: HIGHEST for action security_group_members [ 936.124639] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 15ffc214-b1d2-4e69-8a67-f9c54cc59db3 with Priority: HIGHEST for action port [ 936.125088] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.125088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.125279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.125315] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.125460] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.126599] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.126818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.126891] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.127081] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.127232] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.127391] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.127391] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.127545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.127634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.127681] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.128846] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-15ffc214-b1d2-4e69-8a67-f9c54cc59db3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.128944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-15ffc214-b1d2-4e69-8a67-f9c54cc59db3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.129027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-15ffc214-b1d2-4e69-8a67-f9c54cc59db3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.129168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-15ffc214-b1d2-4e69-8a67-f9c54cc59db3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.129247] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('15ffc214-b1d2-4e69-8a67-f9c54cc59db3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.441048] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bc7b7d78-f994-42d1-964f-0485a67466cc: rpc.has_security_group_logging(os_id): False [ 936.465243] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.465444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.465444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.465761] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.465851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.466118] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.466222] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.466286] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.466441] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.466518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.466667] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc7b7d78-f994-42d1-964f-0485a67466cc is going to be created. [ 936.564353] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.564606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.564606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.564811] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.565007] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.580147] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc7b7d78-f994-42d1-964f-0485a67466cc in Status: IN_PROGRESS for 2s [ 936.628484] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.628484] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.630959] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.634041] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 15ffc214-b1d2-4e69-8a67-f9c54cc59db3 with status ACTIVE [ 936.634041] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.634041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.634041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.634041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.634520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.638028] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.638028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.638028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.638028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.638028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.638028] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.638028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.638028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.638028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.638028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.638028] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 15ffc214-b1d2-4e69-8a67-f9c54cc59db3 is going to be updated. [ 936.673325] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.673325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.673325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.673325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.673325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.673325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-15ffc214-b1d2-4e69-8a67-f9c54cc59db3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.868057] env[65413]: INFO networking_nsxv3.common.synchronization [req-e59faf40-f5f6-4745-82ef-18a622403ef8 req-6849b77f-5564-435d-bb22-bea771fd8e35 tempest-ImagesTestJSON-1309992501 tempest-ImagesTestJSON-1309992501-project-member] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 936.868781] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 936.869857] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.870011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.870083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.870366] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.871034] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.871235] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.871642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.871880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.871980] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.872107] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.133016] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.248381] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-954 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.248593] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.248727] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.249015] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.249291] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.249506] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.249682] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.249947] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.250155] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.250406] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.250554] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.250698] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.250822] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.250964] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.251145] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.251309] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.275102] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.275102] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 937.275102] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.275102] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.275102] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-32ef6909-ea9a-4e6f-92a3-c20ac33a6be2 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.275102] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-32ef6909-ea9a-4e6f-92a3-c20ac33a6be2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.275102] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-32ef6909-ea9a-4e6f-92a3-c20ac33a6be2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.275512] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-32ef6909-ea9a-4e6f-92a3-c20ac33a6be2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.275548] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32ef6909-ea9a-4e6f-92a3-c20ac33a6be2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.375477] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.635729] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.635729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.635936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.635986] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.636170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.636301] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 is going to be created. [ 937.662570] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.662763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.662814] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.663086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.663282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.673907] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 in Status: UNINITIALIZED for 2s [ 937.779571] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.779571] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.779571] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.779571] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.779900] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.780044] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 32ef6909-ea9a-4e6f-92a3-c20ac33a6be2 not found, creating... [ 937.780376] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.780644] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.780819] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.781139] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.783042] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.783042] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.783042] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.783042] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.783042] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.783042] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.783042] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 32ef6909-ea9a-4e6f-92a3-c20ac33a6be2 is going to be created. [ 937.816880] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.817214] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.817214] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.817622] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.817914] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.818183] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-32ef6909-ea9a-4e6f-92a3-c20ac33a6be2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.877313] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.380603] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.381053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.381053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.381194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.381287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.381393] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 938.421604] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.421766] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.421838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.422076] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.422225] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.432357] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 938.567954] env[65413]: INFO networking_nsxv3.common.synchronization [req-e59faf40-f5f6-4745-82ef-18a622403ef8 req-263257ce-9519-4502-bed1-2ed91efccc88 service nova] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_rules [ 938.568150] env[65413]: INFO networking_nsxv3.common.synchronization [req-e59faf40-f5f6-4745-82ef-18a622403ef8 req-263257ce-9519-4502-bed1-2ed91efccc88 service nova] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 938.568372] env[65413]: INFO networking_nsxv3.common.synchronization [req-e59faf40-f5f6-4745-82ef-18a622403ef8 req-263257ce-9519-4502-bed1-2ed91efccc88 service nova] Enqueued Resource ID: 32ef6909-ea9a-4e6f-92a3-c20ac33a6be2 with Priority: HIGHEST for action port [ 938.568508] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_rules [ 938.568675] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 938.568779] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ef6909-ea9a-4e6f-92a3-c20ac33a6be2 with Priority: HIGHEST for action port [ 938.569341] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.569615] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.569615] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.570171] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.570263] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.571452] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.571576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.571807] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-32ef6909-ea9a-4e6f-92a3-c20ac33a6be2 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.571915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32ef6909-ea9a-4e6f-92a3-c20ac33a6be2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.571980] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32ef6909-ea9a-4e6f-92a3-c20ac33a6be2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.572835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32ef6909-ea9a-4e6f-92a3-c20ac33a6be2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.572835] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32ef6909-ea9a-4e6f-92a3-c20ac33a6be2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.593908] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bc7b7d78-f994-42d1-964f-0485a67466cc in Status: SUCCESS [ 938.594167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.074410] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.074546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.076021] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 32ef6909-ea9a-4e6f-92a3-c20ac33a6be2 with status ACTIVE [ 939.076958] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.077284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.077365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.077597] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.077848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.077954] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.078076] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.078135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.078450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.078531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.078760] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.079207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.079305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.079522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.079661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.079736] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 32ef6909-ea9a-4e6f-92a3-c20ac33a6be2 is going to be updated. [ 939.103291] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.103448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.103534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.103718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.103806] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.103951] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32ef6909-ea9a-4e6f-92a3-c20ac33a6be2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.685943] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 in Status: SUCCESS [ 939.685943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.685943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.685943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.685943] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.685943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.685943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.685943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.685943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.685943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.685943] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.188149] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.445297] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 940.447121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.447121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.447121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.447121] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.447121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.447121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.447121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.447121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.447121] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.691138] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9: rpc.has_security_group_logging(os_id): False [ 940.709983] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.710152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.710225] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.710618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.710618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.710769] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.710859] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.710911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.711196] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.711196] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.711285] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 is going to be created. [ 940.771478] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.771709] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.771772] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.772014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.772184] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.785149] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 in Status: IN_PROGRESS for 2s [ 940.950279] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.452411] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.955143] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.955477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.955477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.955600] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.955729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.955838] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 942.000826] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.001026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.001075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.001318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.001470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.012404] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 942.800058] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 in Status: SUCCESS [ 942.800360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.569682] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 943.570100] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 944.026826] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 944.027057] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.027322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.027564] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.027758] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.027882] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.027946] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.028141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.028344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.028447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.028552] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.531642] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.531858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.531858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.532083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.532256] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.533071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.533160] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.533316] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.533422] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.533515] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.533693] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.533783] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.533844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.533989] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.534156] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.534250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.534308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.534464] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.534537] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.534628] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.534717] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.036974] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 650f4003-0da8-43a0-bfde-c7d15e589861: rpc.has_security_group_logging(os_id): False [ 945.059688] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.059949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.060079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.060422] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.060422] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.060744] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.060970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.061142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.061457] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.061898] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.062187] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.062360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.062434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.062698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.062792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.063022] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.063169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.063240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.063420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.063493] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.063617] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 945.148407] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.148407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.148407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.148407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.148407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.164810] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 947.185123] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 947.185123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.308254] env[65413]: INFO networking_nsxv3.common.synchronization [req-b8224d8e-502b-4ecf-8ab8-82d0b6d7fd8d req-dd8951eb-247d-4754-95eb-0888bf48caf0 tempest-ServerDiskConfigTestJSON-938124936 tempest-ServerDiskConfigTestJSON-938124936-project-member] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 948.308915] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 948.309259] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.309386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.309454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.309666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.309820] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.309918] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.309981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.310144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.310226] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.310316] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.813506] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.813689] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.813786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.815702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.815702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.815702] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.815702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.815702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.815702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.815702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.815702] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 948.852208] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.852521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.852521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.852830] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.852888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.869775] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 949.660340] env[65413]: INFO networking_nsxv3.common.synchronization [req-aa35f224-46bd-4f45-b6ad-7da68d058ae6 req-b6dfef9d-4e8d-4a0c-8b2d-94339b95cd3e tempest-ServerActionsTestOtherA-276981019 tempest-ServerActionsTestOtherA-276981019-project-member] Enqueued Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_members [ 949.660340] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_members [ 949.661024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e429593-1cb3-44b2-8d70-77fbe7afbed5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.662085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.662085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.662085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.662085] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.662085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.662688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.663012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.663279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.663536] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.142966] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-598 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.143266] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.143990] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.143990] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.144192] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.144378] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.144465] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.144767] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.144839] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.145066] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.145269] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 950.145569] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 950.145569] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 950.145676] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 950.145676] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 950.145804] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 950.167518] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.167518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.167518] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.167799] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.167799] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.168202] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.168202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.168202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.168202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.168393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.168393] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 already deleted. [ 950.168451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.174202] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 950.174474] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 950.174775] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 950.175078] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.175555] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-0aa98992-dec5-4730-948e-ad2065af9cd2 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.178886] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-0aa98992-dec5-4730-948e-ad2065af9cd2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.178886] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-0aa98992-dec5-4730-948e-ad2065af9cd2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.178886] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-0aa98992-dec5-4730-948e-ad2065af9cd2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.178886] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aa98992-dec5-4730-948e-ad2065af9cd2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.679959] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.680309] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.680309] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.680581] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.680731] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.680926] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 0aa98992-dec5-4730-948e-ad2065af9cd2 not found, creating... [ 950.681213] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.681377] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.681494] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.681823] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.681963] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.682293] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.682445] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.682608] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.682829] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.683077] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.683246] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 0aa98992-dec5-4730-948e-ad2065af9cd2 is going to be created. [ 950.712306] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.712551] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.712669] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.712931] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.713168] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.713391] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-0aa98992-dec5-4730-948e-ad2065af9cd2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.884924] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 950.885082] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 deletion is rescheduled due to dependency. [ 950.885262] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.410767] env[65413]: INFO networking_nsxv3.common.synchronization [req-aa35f224-46bd-4f45-b6ad-7da68d058ae6 req-4b1149bd-f95a-4b3b-a483-688bda9c21e1 service nova] Enqueued Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_rules [ 951.410958] env[65413]: INFO networking_nsxv3.common.synchronization [req-aa35f224-46bd-4f45-b6ad-7da68d058ae6 req-4b1149bd-f95a-4b3b-a483-688bda9c21e1 service nova] Enqueued Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_members [ 951.411109] env[65413]: INFO networking_nsxv3.common.synchronization [req-aa35f224-46bd-4f45-b6ad-7da68d058ae6 req-4b1149bd-f95a-4b3b-a483-688bda9c21e1 service nova] Enqueued Resource ID: 0aa98992-dec5-4730-948e-ad2065af9cd2 with Priority: HIGHEST for action port [ 951.411668] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_rules [ 951.411816] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_members [ 951.411913] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0aa98992-dec5-4730-948e-ad2065af9cd2 with Priority: HIGHEST for action port [ 951.412223] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e429593-1cb3-44b2-8d70-77fbe7afbed5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.412314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.412570] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.412678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.412721] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.413535] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e429593-1cb3-44b2-8d70-77fbe7afbed5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.416632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.416632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.416632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.416632] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.416632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.416632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.416632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.416632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.416632] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.416632] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0aa98992-dec5-4730-948e-ad2065af9cd2 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.416632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0aa98992-dec5-4730-948e-ad2065af9cd2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.416632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0aa98992-dec5-4730-948e-ad2065af9cd2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.416632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0aa98992-dec5-4730-948e-ad2065af9cd2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.416632] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0aa98992-dec5-4730-948e-ad2065af9cd2',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.917549] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e429593-1cb3-44b2-8d70-77fbe7afbed5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.917875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.917961] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0aa98992-dec5-4730-948e-ad2065af9cd2 with status ACTIVE [ 951.918637] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.918637] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.918637] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.918817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.918915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.919418] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.919495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.919495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.920502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.920502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.920502] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.920502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.920502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.920954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.920954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.920954] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0aa98992-dec5-4730-948e-ad2065af9cd2 is going to be updated. [ 951.922539] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.944440] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.944731] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.944731] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.944969] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.945264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.945429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0aa98992-dec5-4730-948e-ad2065af9cd2" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.203742] env[65413]: INFO networking_nsxv3.common.synchronization [req-af2a2b78-6e90-4e28-b61d-eccfcb1dee14 req-277ef9e6-5087-4dd5-b0ba-8dd2095402ee tempest-AttachInterfacesV270Test-113617806 tempest-AttachInterfacesV270Test-113617806-project-member] Enqueued Resource ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 with Priority: HIGHEST for action security_group_members [ 952.205030] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 with Priority: HIGHEST for action security_group_members [ 952.205353] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.205641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.205759] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.206117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.206484] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.206717] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.206717] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.208822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.208822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.208822] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af57a10c-d2fd-4a8a-8e67-890fc4b4d689',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.428020] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.624039] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-922 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.624039] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-922" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.624039] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-922" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.624039] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-922" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.624039] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.624508] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.624508] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.624508] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.624723] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.624723] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 952.624828] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 952.624912] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 952.625022] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 952.625131] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 952.625218] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 952.625341] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 952.652353] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 952.652522] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 952.652658] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 952.653140] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-922" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.653695] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-b5ae62a8-046f-4aa3-9c46-a012082493dc taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.653967] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-b5ae62a8-046f-4aa3-9c46-a012082493dc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.654154] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-b5ae62a8-046f-4aa3-9c46-a012082493dc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.654584] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-b5ae62a8-046f-4aa3-9c46-a012082493dc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.654797] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5ae62a8-046f-4aa3-9c46-a012082493dc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.709606] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.709761] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.709872] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.710137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.710234] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.710437] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.710539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.710609] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.710768] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.710841] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.710922] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 already deleted. [ 952.710997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.931032] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.931032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.931032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.931032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.931522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.931522] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 is going to be created. [ 952.958598] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.958598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.958598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.958598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.958598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.969408] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 in Status: UNINITIALIZED for 2s [ 953.160282] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.160673] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.160822] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.161158] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.161306] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.161461] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port b5ae62a8-046f-4aa3-9c46-a012082493dc not found, creating... [ 953.161824] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.162129] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.162251] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.162486] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.162625] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.162947] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.163122] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.163241] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.163455] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.163581] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.163716] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: b5ae62a8-046f-4aa3-9c46-a012082493dc is going to be created. [ 953.188900] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.189186] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.189344] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.189817] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.190161] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.190394] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-b5ae62a8-046f-4aa3-9c46-a012082493dc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.859426] env[65413]: INFO networking_nsxv3.common.synchronization [req-af2a2b78-6e90-4e28-b61d-eccfcb1dee14 req-f5e8804c-a028-42db-a82e-0c403c5be6c7 service nova] Enqueued Resource ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 with Priority: HIGHEST for action security_group_rules [ 953.859650] env[65413]: INFO networking_nsxv3.common.synchronization [req-af2a2b78-6e90-4e28-b61d-eccfcb1dee14 req-f5e8804c-a028-42db-a82e-0c403c5be6c7 service nova] Enqueued Resource ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 with Priority: HIGHEST for action security_group_members [ 953.859785] env[65413]: INFO networking_nsxv3.common.synchronization [req-af2a2b78-6e90-4e28-b61d-eccfcb1dee14 req-f5e8804c-a028-42db-a82e-0c403c5be6c7 service nova] Enqueued Resource ID: b5ae62a8-046f-4aa3-9c46-a012082493dc with Priority: HIGHEST for action port [ 953.860319] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 with Priority: HIGHEST for action security_group_rules [ 953.860450] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 with Priority: HIGHEST for action security_group_members [ 953.860547] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5ae62a8-046f-4aa3-9c46-a012082493dc with Priority: HIGHEST for action port [ 953.860829] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af57a10c-d2fd-4a8a-8e67-890fc4b4d689 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.860968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.861055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.861771] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.862038] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af57a10c-d2fd-4a8a-8e67-890fc4b4d689',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.863302] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.863611] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.863722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.863947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.864200] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.864345] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.865553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.865553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.865553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.865553] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af57a10c-d2fd-4a8a-8e67-890fc4b4d689',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.867144] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5ae62a8-046f-4aa3-9c46-a012082493dc taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.867144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5ae62a8-046f-4aa3-9c46-a012082493dc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.867144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5ae62a8-046f-4aa3-9c46-a012082493dc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.867144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5ae62a8-046f-4aa3-9c46-a012082493dc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.867144] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5ae62a8-046f-4aa3-9c46-a012082493dc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.368952] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('af57a10c-d2fd-4a8a-8e67-890fc4b4d689',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.370392] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.370500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.370678] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5ae62a8-046f-4aa3-9c46-a012082493dc with status ACTIVE [ 954.370943] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.370943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.371042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.371202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.371290] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.371453] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.371548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.371631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.371807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.371850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.372038] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.372134] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.373933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.373933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.373933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.373933] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5ae62a8-046f-4aa3-9c46-a012082493dc is going to be updated. [ 954.399588] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.399763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.399943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.400159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.400427] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.400588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5ae62a8-046f-4aa3-9c46-a012082493dc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.621946] env[65413]: INFO networking_nsxv3.common.synchronization [req-2bd374ca-4bf2-414b-984f-c9cf0b95736f req-0bd23441-5569-435a-b44a-f66a143d15db tempest-ServersTestMultiNic-1690690875 tempest-ServersTestMultiNic-1690690875-project-member] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 954.622513] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 954.622945] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.623022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.623094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.623301] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.623458] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.623556] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.623618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.623763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.623863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.623934] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.877033] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('af57a10c-d2fd-4a8a-8e67-890fc4b4d689',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.912448] env[65413]: INFO networking_nsxv3.common.synchronization [req-2bd374ca-4bf2-414b-984f-c9cf0b95736f req-0653e3f1-7563-447e-8fdb-d8483856679b tempest-ServersTestMultiNic-1690690875 tempest-ServersTestMultiNic-1690690875-project-member] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 954.913050] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 954.913416] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.913506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.979670] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 in Status: SUCCESS [ 954.980026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.980026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.980143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.980303] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.980413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.980470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.980642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.980724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.980819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.980952] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.126520] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.126713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.126751] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.127035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.127035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.127226] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.127323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.127382] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.127523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.127596] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.127677] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be updated. [ 955.156144] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.156144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.156144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.156664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.156664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.166209] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 955.267021] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-101 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.267021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-101" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.267021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-101" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.267021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-101" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.267021] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.267021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.267021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.267021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.268556] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.268709] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.269090] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 955.269090] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 955.269216] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 955.269415] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 955.269622] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 955.269864] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 955.292992] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 955.293190] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 955.293326] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 955.293499] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-101" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.293812] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.293995] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.294119] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.294432] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.294568] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.380604] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.380896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.380896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.381096] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.381217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.381290] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 is going to be created. [ 955.407065] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.407258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.407310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.407520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.407681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.420856] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 in Status: UNINITIALIZED for 2s [ 955.483438] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e429593-1cb3-44b2-8d70-77fbe7afbed5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.483575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.483618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.483843] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.484024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.484130] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.484193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.484344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.484423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.484506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.484646] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e429593-1cb3-44b2-8d70-77fbe7afbed5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.484736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.484794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.484924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.485066] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.485148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.485232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.485517] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.485611] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.485704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.485813] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.798247] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.798596] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.798864] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.798983] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.799123] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.799349] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5 not found, creating... [ 955.799788] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.799979] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.800242] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.800562] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.800670] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.801037] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.801221] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.801329] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.801531] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.801708] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.801859] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5 is going to be created. [ 955.836078] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.838035] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.838035] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.838035] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.838232] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.839030] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.988354] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e429593-1cb3-44b2-8d70-77fbe7afbed5: rpc.has_security_group_logging(os_id): False [ 956.020476] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.020666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.020666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.024028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.024028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.024028] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.024028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.024028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.024028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.024028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.024028] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.024028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.024028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.024028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.024028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.024028] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.024028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.024816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.024816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.024816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.024816] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 is going to be created. [ 956.107652] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.107652] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.107652] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.107966] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.108040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.126771] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 in Status: IN_PROGRESS for 2s [ 956.550610] env[65413]: INFO networking_nsxv3.common.synchronization [req-2bd374ca-4bf2-414b-984f-c9cf0b95736f req-b666124a-eed4-4462-8c33-3e0c85be9716 service nova] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_rules [ 956.550921] env[65413]: INFO networking_nsxv3.common.synchronization [req-2bd374ca-4bf2-414b-984f-c9cf0b95736f req-b666124a-eed4-4462-8c33-3e0c85be9716 service nova] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 956.551103] env[65413]: INFO networking_nsxv3.common.synchronization [req-2bd374ca-4bf2-414b-984f-c9cf0b95736f req-b666124a-eed4-4462-8c33-3e0c85be9716 service nova] Enqueued Resource ID: a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5 with Priority: HIGHEST for action port [ 956.551670] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_rules [ 956.551813] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 956.551912] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5 with Priority: HIGHEST for action port [ 956.552241] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.552770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.552846] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.553070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.553154] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.553981] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.554082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.554276] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.554373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.554434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.554602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.554676] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.057010] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.057010] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.057377] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5 with status ACTIVE [ 957.057377] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.057377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.057377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.057657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.057657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.057839] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.057915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.057968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.058124] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.058202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.058400] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.058500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.058558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.058668] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.058737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.058816] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5 is going to be updated. [ 957.081550] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.081772] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.081852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.082044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.082170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.082325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a22b2001-9dc9-4e38-998f-c8a0bc3cf4b5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.127303] env[65413]: INFO networking_nsxv3.common.synchronization [req-d727fe9d-cd3a-4e3f-bc76-0848d55b7508 req-3a0c923f-53d1-4b6f-a0af-154bb936652c tempest-ImagesTestJSON-1309992501 tempest-ImagesTestJSON-1309992501-project-member] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 957.127631] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 957.127954] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.128090] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.128157] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.128359] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.128513] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.128615] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.128678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.128823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.128908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.129061] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.182172] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 957.183127] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 deletion is rescheduled due to dependency. [ 957.183127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.185083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.185667] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.185667] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.185813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.185909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.186148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.186237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.186336] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.358663] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-381 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.358868] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-381" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.358991] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-381" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.359358] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-381" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.359661] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.359796] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.359924] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.360174] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.360328] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.360541] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.360656] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 957.360785] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 957.361136] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 957.361288] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 957.361402] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 957.361543] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 957.386297] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 957.386469] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 957.386605] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 957.386841] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-381" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.387193] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-098b3739-b5f6-4587-adbb-77ac8231ae28 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.387369] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-098b3739-b5f6-4587-adbb-77ac8231ae28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.387487] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-098b3739-b5f6-4587-adbb-77ac8231ae28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.387835] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-098b3739-b5f6-4587-adbb-77ac8231ae28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.387972] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('098b3739-b5f6-4587-adbb-77ac8231ae28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.431801] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 in Status: SUCCESS [ 957.431998] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.432196] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.432449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.432934] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.432934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.432934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.433142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.433142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.433142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.433242] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('af57a10c-d2fd-4a8a-8e67-890fc4b4d689',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.630981] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.688691] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.890373] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.890899] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.891152] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.891574] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.891837] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.892128] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 098b3739-b5f6-4587-adbb-77ac8231ae28 not found, creating... [ 957.892506] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.892750] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.892919] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.893316] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.893516] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.894113] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.894350] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.894561] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.894898] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.895103] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.895338] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 098b3739-b5f6-4587-adbb-77ac8231ae28 is going to be created. [ 957.922932] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.923242] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.923369] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.923639] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.924031] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.924278] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-098b3739-b5f6-4587-adbb-77ac8231ae28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.935981] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.936164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.936241] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.936455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.936618] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.936732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.936794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.936991] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.937113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.937208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.937366] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.937449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.937510] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.937653] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.937788] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.937879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.937932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.938084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.938170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.938285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.938392] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('af57a10c-d2fd-4a8a-8e67-890fc4b4d689',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.133275] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.138935] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 in Status: SUCCESS [ 958.139195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.191108] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.441193] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for af57a10c-d2fd-4a8a-8e67-890fc4b4d689: rpc.has_security_group_logging(os_id): False [ 958.460121] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.460276] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.460353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.460577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.460664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.460851] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.460950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.461024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.461176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.461251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.461444] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.461537] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.461596] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.461755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.461828] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.462009] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.462385] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.462385] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.462482] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.462482] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.462546] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 is going to be created. [ 958.517396] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.517545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.517617] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.517840] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.518029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.534200] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 in Status: IN_PROGRESS for 2s [ 958.636282] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.636282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.638098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.638098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.638098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.638098] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 958.653208] env[65413]: INFO networking_nsxv3.common.synchronization [req-2bd374ca-4bf2-414b-984f-c9cf0b95736f req-f8adf396-2490-408b-9eaf-3c340036b4f1 service nova] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_rules [ 958.653315] env[65413]: INFO networking_nsxv3.common.synchronization [req-2bd374ca-4bf2-414b-984f-c9cf0b95736f req-f8adf396-2490-408b-9eaf-3c340036b4f1 service nova] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 958.654036] env[65413]: INFO networking_nsxv3.common.synchronization [req-2bd374ca-4bf2-414b-984f-c9cf0b95736f req-f8adf396-2490-408b-9eaf-3c340036b4f1 service nova] Enqueued Resource ID: 098b3739-b5f6-4587-adbb-77ac8231ae28 with Priority: HIGHEST for action port [ 958.654130] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_rules [ 958.654237] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 958.654336] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 098b3739-b5f6-4587-adbb-77ac8231ae28 with Priority: HIGHEST for action port [ 958.654723] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.654723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.654908] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.655011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.655215] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-098b3739-b5f6-4587-adbb-77ac8231ae28 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.655377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-098b3739-b5f6-4587-adbb-77ac8231ae28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.655377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-098b3739-b5f6-4587-adbb-77ac8231ae28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.655579] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-098b3739-b5f6-4587-adbb-77ac8231ae28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.655658] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('098b3739-b5f6-4587-adbb-77ac8231ae28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.670641] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.670789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.670889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.671108] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.671256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.684029] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 958.694087] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.694087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.694250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.694487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.694618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.694790] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be updated. [ 958.739343] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.739490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.739581] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.739822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.739970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.752901] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 959.161330] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 098b3739-b5f6-4587-adbb-77ac8231ae28 with status ACTIVE [ 959.161582] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.161793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.161864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.162109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.162194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.162378] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.162477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.162577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.162709] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.162791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.162974] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.163079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.163140] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.163279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.163350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.163433] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 098b3739-b5f6-4587-adbb-77ac8231ae28 is going to be updated. [ 959.187669] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.187820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.187876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.188127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.188273] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.188492] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-098b3739-b5f6-4587-adbb-77ac8231ae28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.613592] env[65413]: INFO networking_nsxv3.common.synchronization [req-90a6f2db-bab8-4b21-b41d-9b11761c7618 req-cb6c232e-93d1-4e66-aefc-27ac5f8e27b3 tempest-ServersTestBootFromVolume-237210338 tempest-ServersTestBootFromVolume-237210338-project-member] Enqueued Resource ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 with Priority: HIGHEST for action security_group_members [ 959.614146] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 with Priority: HIGHEST for action security_group_members [ 959.614453] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.614567] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.614631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.614892] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.615142] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.615502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.615502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.615651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.615764] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.615884] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0e27d-c1b3-4c8e-bf7a-7837e9769380',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.924106] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-269 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.924106] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-269" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.924106] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-269" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.924106] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-269" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.924629] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.924944] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.925180] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.925484] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.925726] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.926030] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.926250] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.926456] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.926645] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.926848] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.927984] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.927984] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.945229] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.945415] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 959.945525] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.945695] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-269" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.946019] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-315cde91-6f6f-44de-b2e6-cb87d0ee2e09 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.946205] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-315cde91-6f6f-44de-b2e6-cb87d0ee2e09" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.946320] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-315cde91-6f6f-44de-b2e6-cb87d0ee2e09" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.946639] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-315cde91-6f6f-44de-b2e6-cb87d0ee2e09" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.946776] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('315cde91-6f6f-44de-b2e6-cb87d0ee2e09',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.117792] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.118215] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.118405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.118740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.118940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.119293] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.119568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.119750] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.120064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.120287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.120468] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 already deleted. [ 960.121597] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.449368] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.452175] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.452175] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.452175] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.452175] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.452175] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 315cde91-6f6f-44de-b2e6-cb87d0ee2e09 not found, creating... [ 960.452175] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.452175] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.452175] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.452175] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.452175] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.452684] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.452684] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.452684] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.454972] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.455124] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.455266] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 315cde91-6f6f-44de-b2e6-cb87d0ee2e09 is going to be created. [ 960.478181] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.478518] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.478518] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.479021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.479021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.480250] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-315cde91-6f6f-44de-b2e6-cb87d0ee2e09" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.547070] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 in Status: SUCCESS [ 960.547070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.694337] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 960.694554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.762771] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 960.762997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.763184] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.763415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.763617] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.763740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.763808] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.763960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.764056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.764152] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.235276] env[65413]: INFO networking_nsxv3.common.synchronization [req-90a6f2db-bab8-4b21-b41d-9b11761c7618 req-e83b9bf4-01ee-48bd-9fee-c22ecd7ea260 service nova] Enqueued Resource ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 with Priority: HIGHEST for action security_group_rules [ 961.235276] env[65413]: INFO networking_nsxv3.common.synchronization [req-90a6f2db-bab8-4b21-b41d-9b11761c7618 req-e83b9bf4-01ee-48bd-9fee-c22ecd7ea260 service nova] Enqueued Resource ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 with Priority: HIGHEST for action security_group_members [ 961.235276] env[65413]: INFO networking_nsxv3.common.synchronization [req-90a6f2db-bab8-4b21-b41d-9b11761c7618 req-e83b9bf4-01ee-48bd-9fee-c22ecd7ea260 service nova] Enqueued Resource ID: 315cde91-6f6f-44de-b2e6-cb87d0ee2e09 with Priority: HIGHEST for action port [ 961.235276] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 with Priority: HIGHEST for action security_group_rules [ 961.235942] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 with Priority: HIGHEST for action security_group_members [ 961.236728] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 315cde91-6f6f-44de-b2e6-cb87d0ee2e09 with Priority: HIGHEST for action port [ 961.237191] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.239547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.239547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.239547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.239547] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdd0e27d-c1b3-4c8e-bf7a-7837e9769380',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.239547] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.239547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.239547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.239547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.239547] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.239547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.239547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.239547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.239547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.245393] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0e27d-c1b3-4c8e-bf7a-7837e9769380',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.245393] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-315cde91-6f6f-44de-b2e6-cb87d0ee2e09 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.245393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-315cde91-6f6f-44de-b2e6-cb87d0ee2e09" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.245393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-315cde91-6f6f-44de-b2e6-cb87d0ee2e09" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.245393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-315cde91-6f6f-44de-b2e6-cb87d0ee2e09" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.245393] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('315cde91-6f6f-44de-b2e6-cb87d0ee2e09',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.266625] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.747819] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bdd0e27d-c1b3-4c8e-bf7a-7837e9769380',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.747819] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.747819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.748127] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 315cde91-6f6f-44de-b2e6-cb87d0ee2e09 with status ACTIVE [ 961.748127] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.748251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.748251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.748457] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.748542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.748714] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.748806] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.748864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.749103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.749195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.749380] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.749469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.749525] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.749690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.749762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.749844] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 315cde91-6f6f-44de-b2e6-cb87d0ee2e09 is going to be updated. [ 961.771695] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.771827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.771827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.772040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.772180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.772331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-315cde91-6f6f-44de-b2e6-cb87d0ee2e09" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.772553] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.249519] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bdd0e27d-c1b3-4c8e-bf7a-7837e9769380',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.274825] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.275144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.275144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.275259] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.275344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.275445] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be updated. [ 962.308291] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.308291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.308291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.308291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.308291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.331615] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 962.725562] env[65413]: INFO networking_nsxv3.common.synchronization [req-23a58eee-13c9-49f1-b775-ef6407cebca5 req-6c04cb4a-ad10-4450-98fc-20483e258c59 tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 with Priority: HIGHEST for action security_group_members [ 962.725562] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 with Priority: HIGHEST for action security_group_members [ 962.725864] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.725864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.725864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.726253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.726510] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.726623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.726724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.726935] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.727117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.727221] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e66f37bc-ef47-4d76-937b-4d1c38a4ffe7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.752524] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.752809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.752993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.753397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.753397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.753611] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 is going to be created. [ 962.794204] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.794204] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.794204] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.794204] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.794204] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.809495] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 in Status: UNINITIALIZED for 2s [ 963.094047] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-210 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.094279] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.094404] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.094733] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.095501] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.095774] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.095886] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.096158] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.096321] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.096574] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.096686] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 963.096834] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 963.096957] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 963.097196] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 963.097307] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 963.097461] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 963.124070] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 963.124070] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 963.124070] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 963.124070] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.124070] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-12539f6b-1b39-4380-af81-2be9c4c55d46 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.124070] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-12539f6b-1b39-4380-af81-2be9c4c55d46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.124070] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-12539f6b-1b39-4380-af81-2be9c4c55d46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.124070] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-12539f6b-1b39-4380-af81-2be9c4c55d46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.124070] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12539f6b-1b39-4380-af81-2be9c4c55d46',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.229368] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.229631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.229721] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.229973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.230081] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.230291] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.230394] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.230458] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.230620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.230696] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.230781] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 already deleted. [ 963.230861] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.627348] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.627727] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.627727] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.627962] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.628124] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.628281] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 12539f6b-1b39-4380-af81-2be9c4c55d46 not found, creating... [ 963.628532] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.628682] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.628795] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.629012] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.629152] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.629425] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.629585] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.629718] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.630110] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.630110] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.630251] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 12539f6b-1b39-4380-af81-2be9c4c55d46 is going to be created. [ 963.652161] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.652381] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.652553] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.652735] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.652994] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.653234] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-12539f6b-1b39-4380-af81-2be9c4c55d46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.346330] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 964.346330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.346330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.346330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.346330] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.346330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.346330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.346330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.346330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.346330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.346330] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.347032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.347237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.347742] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.347742] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.347742] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.347742] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.347968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.347968] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.453373] env[65413]: INFO networking_nsxv3.common.synchronization [req-23a58eee-13c9-49f1-b775-ef6407cebca5 req-8b87e356-7ba5-42ba-92fb-0cb3d8a9bb6f service nova] Enqueued Resource ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 with Priority: HIGHEST for action security_group_rules [ 964.454223] env[65413]: INFO networking_nsxv3.common.synchronization [req-23a58eee-13c9-49f1-b775-ef6407cebca5 req-8b87e356-7ba5-42ba-92fb-0cb3d8a9bb6f service nova] Enqueued Resource ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 with Priority: HIGHEST for action security_group_members [ 964.456081] env[65413]: INFO networking_nsxv3.common.synchronization [req-23a58eee-13c9-49f1-b775-ef6407cebca5 req-8b87e356-7ba5-42ba-92fb-0cb3d8a9bb6f service nova] Enqueued Resource ID: 12539f6b-1b39-4380-af81-2be9c4c55d46 with Priority: HIGHEST for action port [ 964.456986] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 with Priority: HIGHEST for action security_group_rules [ 964.457164] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 with Priority: HIGHEST for action security_group_members [ 964.457268] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12539f6b-1b39-4380-af81-2be9c4c55d46 with Priority: HIGHEST for action port [ 964.457707] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.457894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.457982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.458281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.458396] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e66f37bc-ef47-4d76-937b-4d1c38a4ffe7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.460936] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.460936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.460936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.460936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.460936] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.460936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.460936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.461281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.461281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.461281] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e66f37bc-ef47-4d76-937b-4d1c38a4ffe7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.465077] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-12539f6b-1b39-4380-af81-2be9c4c55d46 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.465077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12539f6b-1b39-4380-af81-2be9c4c55d46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.465077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12539f6b-1b39-4380-af81-2be9c4c55d46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.465077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12539f6b-1b39-4380-af81-2be9c4c55d46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.465908] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12539f6b-1b39-4380-af81-2be9c4c55d46',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.822425] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 in Status: SUCCESS [ 964.822830] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.822830] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.823180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.823424] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.823602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.823677] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.823838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.824055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.824133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.824223] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bdd0e27d-c1b3-4c8e-bf7a-7837e9769380',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.849637] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.849795] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.852197] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.969016] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e66f37bc-ef47-4d76-937b-4d1c38a4ffe7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.970938] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.970938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.970938] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12539f6b-1b39-4380-af81-2be9c4c55d46 with status ACTIVE [ 964.970938] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.970938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.971344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.971344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.971417] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.971555] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.971736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.971804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.971957] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.972070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.972264] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.972373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.972432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.973106] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.973106] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.973106] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12539f6b-1b39-4380-af81-2be9c4c55d46 is going to be updated. [ 964.999644] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.999644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.999857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.999961] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.000044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.000194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12539f6b-1b39-4380-af81-2be9c4c55d46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.327099] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bdd0e27d-c1b3-4c8e-bf7a-7837e9769380',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.354267] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.477040] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e66f37bc-ef47-4d76-937b-4d1c38a4ffe7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.830435] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bdd0e27d-c1b3-4c8e-bf7a-7837e9769380: rpc.has_security_group_logging(os_id): False [ 965.852515] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.852614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.852656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.852908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.853024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.853267] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.853373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.853433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.853575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.853645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.853733] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 is going to be created. [ 965.855892] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.856020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.856083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.856250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.856409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.856409] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be updated. [ 965.893375] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.893548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.893588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.893916] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.894118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.905366] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 965.938358] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.938358] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.938657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.938657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.938830] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.956378] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 in Status: IN_PROGRESS for 2s [ 965.980351] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.980556] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.980556] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.980791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.980944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.981082] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 is going to be created. [ 966.015988] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.016245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.016245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.017052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.017052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.060397] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 in Status: UNINITIALIZED for 2s [ 967.919639] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 967.920167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.920234] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.920459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.920920] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.921094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.921192] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.921397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.921521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.921608] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.921836] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.921982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.922097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.922221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.922384] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.922488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.922555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.922753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.922864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.922980] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.924468] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.976837] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 in Status: SUCCESS [ 967.977112] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.073990] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 in Status: SUCCESS [ 968.074289] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.074540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.077024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.077024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.077024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.077296] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.077296] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.077418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.077462] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.077531] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e66f37bc-ef47-4d76-937b-4d1c38a4ffe7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.429397] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d92a9ea-1a70-4bff-aac7-578c2d7396f3: rpc.has_security_group_logging(os_id): False [ 968.449038] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.450087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.450087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.450087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.450087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.450087] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.450087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.450087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.450318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.450318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.450446] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.450446] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.450515] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.451229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.451229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.451229] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.451543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.451543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.451543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.451543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.451766] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be updated. [ 968.524872] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.525101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.525211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.525489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.525673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.544887] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 968.582680] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e66f37bc-ef47-4d76-937b-4d1c38a4ffe7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.925560] env[65413]: INFO networking_nsxv3.common.synchronization [req-9628e892-bcff-4a78-8922-b66a0e347fa3 req-9d727830-e95c-4df4-8f42-0135f8b367ae tempest-AttachInterfacesV270Test-113617806 tempest-AttachInterfacesV270Test-113617806-project-member] Enqueued Resource ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 with Priority: HIGHEST for action security_group_members [ 968.926097] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 with Priority: HIGHEST for action security_group_members [ 968.926617] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.926922] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.927147] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.927433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.927680] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.927895] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.928143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.928441] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.928644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.928838] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('af57a10c-d2fd-4a8a-8e67-890fc4b4d689',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.085454] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e66f37bc-ef47-4d76-937b-4d1c38a4ffe7: rpc.has_security_group_logging(os_id): False [ 969.109097] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.109359] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.109449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.109842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.109945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.110706] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.110706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.110706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.110706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.110887] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.110922] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 is going to be created. [ 969.175908] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.176187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.176249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.176499] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.176738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.189470] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 in Status: IN_PROGRESS for 2s [ 969.431862] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.432255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.432255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.432255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.433211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.433211] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.433211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.433211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.433211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.433211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.433211] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 is going to be updated. [ 969.469558] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.469723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.469816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.470279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.470400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.484022] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 in Status: IN_PROGRESS for 2s [ 969.484487] env[65413]: INFO networking_nsxv3.common.synchronization [None req-b045295a-58ca-41da-8283-49cf6150c1bc tempest-AttachVolumeTestJSON-893762802 tempest-AttachVolumeTestJSON-893762802-project-member] Enqueued Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGHEST for action security_group_rules [ 969.485028] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGHEST for action security_group_rules [ 969.485350] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edbcf595-e502-4812-b097-93b4e6d1355d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.485510] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.485577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.485910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.485996] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edbcf595-e502-4812-b097-93b4e6d1355d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.514613] env[65413]: INFO networking_nsxv3.common.synchronization [None req-fc58424e-17bb-4eae-aa1b-093669253414 None None] Enqueued Resource ID: 7ab464dc-6ae1-4430-8490-c54884d8d053 with Priority: HIGHEST for action port [ 969.515320] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ab464dc-6ae1-4430-8490-c54884d8d053 with Priority: HIGHEST for action port [ 969.515687] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-7ab464dc-6ae1-4430-8490-c54884d8d053 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.515834] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7ab464dc-6ae1-4430-8490-c54884d8d053" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.515945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7ab464dc-6ae1-4430-8490-c54884d8d053" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.520024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7ab464dc-6ae1-4430-8490-c54884d8d053" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.520024] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7ab464dc-6ae1-4430-8490-c54884d8d053',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.604647] env[65413]: INFO networking_nsxv3.common.synchronization [None req-e34d7a39-1cc0-47e6-a27f-064f2cdd47f3 tempest-AttachVolumeTestJSON-893762802 tempest-AttachVolumeTestJSON-893762802-project-member] Enqueued Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGHEST for action security_group_rules [ 969.605235] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGHEST for action security_group_rules [ 969.605548] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edbcf595-e502-4812-b097-93b4e6d1355d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.605650] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.007411] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.007846] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.007846] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.007945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.008652] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.008652] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edbcf595-e502-4812-b097-93b4e6d1355d already deleted. [ 970.008652] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.008652] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.008652] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.008652] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edbcf595-e502-4812-b097-93b4e6d1355d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.019825] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7ab464dc-6ae1-4430-8490-c54884d8d053 [ 970.020138] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.020291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.020351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.020551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.021025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.021025] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7ab464dc-6ae1-4430-8490-c54884d8d053 already deleted. [ 970.021025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7ab464dc-6ae1-4430-8490-c54884d8d053" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.530112] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.532964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.532964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.532964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.532964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.532964] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edbcf595-e502-4812-b097-93b4e6d1355d already deleted. [ 970.532964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.564098] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 970.564467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.564684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.564910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.565042] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.842923] env[65413]: INFO networking_nsxv3.common.synchronization [req-ab798cc1-15c0-4101-8d59-2312492b10de req-b19201b3-9ba9-496c-92ce-95c3626757ee tempest-DeleteServersTestJSON-2008533967 tempest-DeleteServersTestJSON-2008533967-project-member] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 970.844033] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 970.844745] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.846690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.846917] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.847344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.847727] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.847984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.848272] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.848603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.848757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.848943] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.072080] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.072080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.072080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.072080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.072080] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.072632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.072632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.072632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.072730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.072813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.072921] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.205674] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 in Status: SUCCESS [ 971.205674] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.356473] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.356473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.356473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.356473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.356473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.356473] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.356473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.356473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.356892] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.356892] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.356892] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 971.361551] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-586 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.361919] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.361919] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.363073] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.363073] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.363073] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.363073] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.364338] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.364544] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.365128] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.365128] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 971.365128] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 971.365303] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 971.367314] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 971.367314] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 971.367314] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 971.394498] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 971.394670] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 971.394884] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 971.395076] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.395498] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.396145] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.396145] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.396308] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.396353] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.402667] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.402841] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.402968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.403184] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.403329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.414249] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 971.509443] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 in Status: SUCCESS [ 971.509737] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 deletion is rescheduled due to dependency. [ 971.509932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.581497] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.581497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.581497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.581497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.581497] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.581497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.581497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.582113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.582113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.582113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.582113] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.582113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.582113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.582348] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.582348] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.582489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.582489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.582618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.582692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.582804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.582854] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.899213] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.899213] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.899213] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.899213] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.899408] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.899544] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b not found, creating... [ 971.899889] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.900462] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.900631] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.900877] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.901026] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.901375] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.901553] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.901791] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.902060] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.902324] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.904519] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b is going to be created. [ 971.930213] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.930213] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.930213] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.930213] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.930213] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.930213] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.086063] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d92a9ea-1a70-4bff-aac7-578c2d7396f3: rpc.has_security_group_logging(os_id): False [ 972.132634] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.132898] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.133049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.133388] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.133461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.133660] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.133785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.133852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.133999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.134134] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.134340] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.134434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.134498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.134668] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.134743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.134954] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.135550] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.135628] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.135792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.135887] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.135965] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be updated. [ 972.260752] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.260752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.260752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.261225] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.261225] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.289590] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 972.460525] env[65413]: INFO networking_nsxv3.common.synchronization [req-ce93d800-017c-4718-a7aa-446b37e8c0ad req-53e34c8f-f5d2-4177-bcb5-f45c4df3400c tempest-ServersTestMultiNic-1690690875 tempest-ServersTestMultiNic-1690690875-project-member] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 972.461166] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 972.461489] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.461602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.461661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.462012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.462939] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.462939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.462939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.462939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.462939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.462939] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.505343] env[65413]: INFO networking_nsxv3.common.synchronization [None req-866a1a09-4c17-40d6-92f3-e6b1285c8a30 None None] Enqueued Resource ID: e953b82f-3969-4418-aa23-b22f32918219 with Priority: HIGHEST for action port [ 972.505343] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e953b82f-3969-4418-aa23-b22f32918219 with Priority: HIGHEST for action port [ 972.505343] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-e953b82f-3969-4418-aa23-b22f32918219 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.505343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e953b82f-3969-4418-aa23-b22f32918219" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.505343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e953b82f-3969-4418-aa23-b22f32918219" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.505593] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e953b82f-3969-4418-aa23-b22f32918219" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.505710] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e953b82f-3969-4418-aa23-b22f32918219',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.670530] env[65413]: INFO networking_nsxv3.common.synchronization [req-ab798cc1-15c0-4101-8d59-2312492b10de req-39caabf1-a18b-4713-9940-6815a41822fb service nova] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_rules [ 972.670675] env[65413]: INFO networking_nsxv3.common.synchronization [req-ab798cc1-15c0-4101-8d59-2312492b10de req-39caabf1-a18b-4713-9940-6815a41822fb service nova] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 972.670814] env[65413]: INFO networking_nsxv3.common.synchronization [req-ab798cc1-15c0-4101-8d59-2312492b10de req-39caabf1-a18b-4713-9940-6815a41822fb service nova] Enqueued Resource ID: 237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b with Priority: HIGHEST for action port [ 972.671358] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_rules [ 972.671808] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 972.671808] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b with Priority: HIGHEST for action port [ 972.671951] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.672408] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.672514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.672787] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.672914] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.674223] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.674359] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.674584] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.674672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.674672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.674854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.674930] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.769255] env[65413]: INFO networking_nsxv3.common.synchronization [req-ce93d800-017c-4718-a7aa-446b37e8c0ad req-e38dc125-7b6d-463a-ad2f-4438af2b335d tempest-ServersTestMultiNic-1690690875 tempest-ServersTestMultiNic-1690690875-project-member] Enqueued Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 972.769820] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 with Priority: HIGHEST for action security_group_members [ 972.770243] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.773950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.966104] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.007573] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e953b82f-3969-4418-aa23-b22f32918219 [ 973.007805] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.007933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.007996] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.008250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.008367] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.008452] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e953b82f-3969-4418-aa23-b22f32918219 already deleted. [ 973.008567] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e953b82f-3969-4418-aa23-b22f32918219" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.177353] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.177721] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.177761] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b with status ACTIVE [ 973.177938] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.178113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.178149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.178338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.178424] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.178599] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.178692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.178754] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.178905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.178982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.182018] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.182018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.182018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.182018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.182018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.182018] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b is going to be updated. [ 973.207981] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.208177] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.208553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.208856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.209027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.209614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-237d1fd5-94bb-4db6-a7d6-bc3e2cb5843b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.428337] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 973.428337] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 deletion is rescheduled due to dependency. [ 973.428428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.428604] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.429271] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.429557] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.429701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.429767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.430191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.430274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.430374] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.468378] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.531925] env[65413]: INFO networking_nsxv3.common.synchronization [req-363ef699-5470-49d9-9bd0-19a9527129e4 req-1c114234-8b27-4272-a4e8-f51f90725eb7 tempest-ServerDiskConfigTestJSON-938124936 tempest-ServerDiskConfigTestJSON-938124936-project-member] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 973.532660] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 973.533084] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.533299] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.533428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.533648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.533814] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.533924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.533976] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.534199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.534232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.534325] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.916040] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.916040] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.916040] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.916040] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.916040] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.916841] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.917252] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.922070] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.922070] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.922070] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.922070] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 973.922070] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 973.922070] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 973.922070] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 973.922070] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 973.922070] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 973.933372] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.944218] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 973.944426] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 973.944585] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 973.944770] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.945139] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-c117090b-c193-417b-a9c4-e318692790cf taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.945332] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-c117090b-c193-417b-a9c4-e318692790cf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.945455] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-c117090b-c193-417b-a9c4-e318692790cf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.945823] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-c117090b-c193-417b-a9c4-e318692790cf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.945967] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c117090b-c193-417b-a9c4-e318692790cf',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.972189] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.972393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.972393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.972614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.972726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.973016] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be updated. [ 974.009210] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.009493] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.009586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.009956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.010258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.023506] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 974.037078] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.037272] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.037316] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.037510] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.037591] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.037777] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.037869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.037926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.038082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.038152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.038233] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 974.068343] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.068525] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.068606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.068845] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.069087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.080642] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 974.312832] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 974.313181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.435781] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.453426] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.453426] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.453426] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.453426] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.453687] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.453729] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port c117090b-c193-417b-a9c4-e318692790cf not found, creating... [ 974.454436] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.454436] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.454436] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.454623] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.454623] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.454929] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.458504] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.458504] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.458504] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.458504] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.458504] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: c117090b-c193-417b-a9c4-e318692790cf is going to be created. [ 974.477553] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.477767] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.477872] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.478394] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.478623] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.478841] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-c117090b-c193-417b-a9c4-e318692790cf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.940887] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.941156] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.941333] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.942701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.942701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.942701] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 974.978359] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.978560] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.978655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.979125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.979125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.989719] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 975.270199] env[65413]: INFO networking_nsxv3.common.synchronization [req-363ef699-5470-49d9-9bd0-19a9527129e4 req-6e2e84a2-8346-464e-a85a-723a742d3d1a service nova] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_rules [ 975.270388] env[65413]: INFO networking_nsxv3.common.synchronization [req-363ef699-5470-49d9-9bd0-19a9527129e4 req-6e2e84a2-8346-464e-a85a-723a742d3d1a service nova] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 975.270528] env[65413]: INFO networking_nsxv3.common.synchronization [req-363ef699-5470-49d9-9bd0-19a9527129e4 req-6e2e84a2-8346-464e-a85a-723a742d3d1a service nova] Enqueued Resource ID: c117090b-c193-417b-a9c4-e318692790cf with Priority: HIGHEST for action port [ 975.271830] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_rules [ 975.272045] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 975.272220] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c117090b-c193-417b-a9c4-e318692790cf with Priority: HIGHEST for action port [ 975.272564] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.272758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.272925] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.273205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.273332] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.277195] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.277195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.277195] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-c117090b-c193-417b-a9c4-e318692790cf taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.277195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c117090b-c193-417b-a9c4-e318692790cf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.277195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c117090b-c193-417b-a9c4-e318692790cf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.277195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c117090b-c193-417b-a9c4-e318692790cf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.277195] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c117090b-c193-417b-a9c4-e318692790cf',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.779834] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.780140] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.780243] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c117090b-c193-417b-a9c4-e318692790cf with status ACTIVE [ 975.780387] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.780490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.780550] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.780762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.780847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.781031] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.781125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.781185] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.781332] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.781408] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.782024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.782190] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.782190] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.782338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.782419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.782460] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c117090b-c193-417b-a9c4-e318692790cf is going to be updated. [ 975.804226] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.804431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.804431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.804648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.804787] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.804947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c117090b-c193-417b-a9c4-e318692790cf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.038478] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 976.038827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.039647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.039647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.039647] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.039647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.039869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.039973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.040088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.040162] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d92a9ea-1a70-4bff-aac7-578c2d7396f3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.091595] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 976.092650] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 deletion is rescheduled due to dependency. [ 976.092906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.093311] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.093637] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.093923] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.094238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.094373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.094574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.094698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.094848] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.542571] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.543553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.543752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.544111] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.544291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.544628] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.544860] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.544993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.545277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.545437] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.545565] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 is going to be updated. [ 976.592160] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.592357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.592445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.592743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.592907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.597699] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.602951] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: IN_PROGRESS for 2s [ 977.001384] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 977.001678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.001756] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.002071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.002277] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.002396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.002463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.002618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.002696] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.002783] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.002876] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.100162] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.504755] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.504928] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.504987] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.505305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.505386] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.505487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.505551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.505700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.505784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.505870] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.506020] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.506117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.506172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.506311] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.506443] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.506531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.506586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.506720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.506793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.506870] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.506958] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.607160] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.607357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.607402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.607606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.607694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.607790] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 977.640356] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.640541] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.640581] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.640778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.640922] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.650357] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 978.009649] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d96dd8be-7e0f-4527-b6b4-1fd21b89c256: rpc.has_security_group_logging(os_id): False [ 978.028110] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.028302] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.028390] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.028998] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.028998] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.028998] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.029220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.029220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.029532] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.029532] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.030066] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.030066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.030066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.030066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.030445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.030445] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.030533] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.030750] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.030750] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.030856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.030920] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 978.100050] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.100133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.100829] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.100829] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.100829] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.116664] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 978.613515] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 in Status: SUCCESS [ 978.613700] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d92a9ea-1a70-4bff-aac7-578c2d7396f3 deletion is rescheduled due to dependency. [ 978.613815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d92a9ea-1a70-4bff-aac7-578c2d7396f3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.668233] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 979.668233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.668595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.668688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.668878] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.669011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.669094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.669273] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.669356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.669440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.669531] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.136042] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 980.136498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.172284] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.172639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.172639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.172795] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.172990] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.173113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.173175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.173327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.173415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.173511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.173683] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.173790] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.173854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.173992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.174128] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.174220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.174279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.174405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.174468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.174558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.174630] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.274276] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 980.275227] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 980.677478] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 579e1066-bea4-4954-a499-fb0ae75b5375: rpc.has_security_group_logging(os_id): False [ 980.698917] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.699171] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.699171] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.699420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.699549] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.699902] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.700060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.700169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.700291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.700384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.700582] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.700680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.700736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.700919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.701024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.705433] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.705433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.705433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.705729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.705729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.705729] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 980.783396] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.783396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.783396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.783396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.783396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.800109] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 981.333547] env[65413]: INFO networking_nsxv3.common.synchronization [req-56e37fdf-324b-40ed-a0f6-03b7bcf1a20b req-cde4758d-12f0-4d03-9059-14f335209621 tempest-ServersTestJSON-725515921 tempest-ServersTestJSON-725515921-project-member] Enqueued Resource ID: bc7b7d78-f994-42d1-964f-0485a67466cc with Priority: HIGHEST for action security_group_members [ 981.334612] env[65413]: INFO networking_nsxv3.common.synchronization [req-650f871d-c120-469e-a576-e45f70216eb6 req-d5b58f20-1001-453f-88e9-8e84fc529739 tempest-ImagesTestJSON-1309992501 tempest-ImagesTestJSON-1309992501-project-member] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 981.336803] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7b7d78-f994-42d1-964f-0485a67466cc with Priority: HIGHEST for action security_group_members [ 981.338161] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 981.338161] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-bc7b7d78-f994-42d1-964f-0485a67466cc taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.338161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.338161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.338161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.339664] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.339664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.339815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.340476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.340846] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.341016] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bc7b7d78-f994-42d1-964f-0485a67466cc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.342198] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.342363] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.342543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.343427] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.343647] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.343790] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.343876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.344101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.344230] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.344361] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.822252] env[65413]: INFO networking_nsxv3.common.synchronization [req-c9edcd0f-f60b-4b50-a04b-73305f46144d req-87d8a30b-62b5-4acf-8b3f-3d82a2b7abad tempest-ServerActionsTestOtherA-276981019 tempest-ServerActionsTestOtherA-276981019-project-member] Enqueued Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_members [ 981.822949] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_members [ 981.829041] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e429593-1cb3-44b2-8d70-77fbe7afbed5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.829041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.829041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.829041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.829041] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.829041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.829041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.829041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.829041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.829041] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.847508] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.847670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.847715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.848137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.848137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.848312] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.848755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.848755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.848755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.848755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.849246] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc7b7d78-f994-42d1-964f-0485a67466cc is going to be updated. [ 981.849994] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.853055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.853055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.853055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.853055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.853055] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.853055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.853055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.853055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.853055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.853055] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 981.892854] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.893031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.893173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.893477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.894059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.896932] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.897069] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.897160] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.897396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.897522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.909504] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc7b7d78-f994-42d1-964f-0485a67466cc in Status: IN_PROGRESS for 2s [ 981.910304] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 982.123227] env[65413]: INFO networking_nsxv3.common.synchronization [req-1cd45d23-a4d6-45bb-93dd-db9e6dc8205b req-ed9eb376-37fe-423a-9ca4-78e25fa9b095 tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 982.124170] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 982.125325] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.125467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.125725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.125725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.125879] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.126376] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.126447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.126611] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.126696] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.126789] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.141401] env[65413]: INFO networking_nsxv3.common.synchronization [req-1fc2855c-c2fa-47b3-9e8e-b86ef28e6606 req-aabe973a-f9ec-404c-8728-ffed30f170a5 tempest-AttachVolumeTestJSON-893762802 tempest-AttachVolumeTestJSON-893762802-project-member] Enqueued Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGHEST for action security_group_members [ 982.142131] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGHEST for action security_group_members [ 982.142606] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-edbcf595-e502-4812-b097-93b4e6d1355d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.142884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.143061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.143429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.143682] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.143911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.145907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.145907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.145907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.145907] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edbcf595-e502-4812-b097-93b4e6d1355d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.332371] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.332620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.332729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.333046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.333046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.333293] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.333416] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.333480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.333640] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.333715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.333806] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 is going to be updated. [ 982.380213] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.380213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.380213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.380213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.380213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.390162] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 in Status: IN_PROGRESS for 2s [ 982.539937] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.539937] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-367" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.540143] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-367" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.540427] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-367" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.541141] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.541314] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.541540] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.541997] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.541997] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.542242] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.542369] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 982.542478] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 982.542585] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 982.542694] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.542798] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 982.542962] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 982.566138] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 982.566353] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 982.566514] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 982.566698] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-367" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.567056] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-7a704222-ef62-43bc-add1-b91f5f86b850 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.567246] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-7a704222-ef62-43bc-add1-b91f5f86b850" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.567367] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-7a704222-ef62-43bc-add1-b91f5f86b850" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.567762] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-7a704222-ef62-43bc-add1-b91f5f86b850" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.567899] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a704222-ef62-43bc-add1-b91f5f86b850',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.581762] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.582016] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.582147] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.582559] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.582668] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.582824] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.582935] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.583374] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.583374] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.583560] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.583670] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 982.583773] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 982.583887] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 982.583992] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 982.584139] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 982.584290] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 982.606278] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 982.606429] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 982.606709] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 982.606961] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.607374] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-b837651b-8123-418b-ab05-4cd3f3f661b7 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.607704] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-b837651b-8123-418b-ab05-4cd3f3f661b7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.607803] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-b837651b-8123-418b-ab05-4cd3f3f661b7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.608411] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-b837651b-8123-418b-ab05-4cd3f3f661b7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.608503] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b837651b-8123-418b-ab05-4cd3f3f661b7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.629096] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.629261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.629323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.629561] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.647526] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.647757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.660058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.660442] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.660633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.660753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.661063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.661209] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.661353] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be updated. [ 982.662548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.662782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.662946] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.663173] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.663724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.663724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.663724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.663724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.663938] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edbcf595-e502-4812-b097-93b4e6d1355d already deleted. [ 982.663938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.693732] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.693963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.694090] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.694485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.694694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.706053] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 982.816488] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 982.816752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.071323] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.071918] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.071918] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.072094] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.072285] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.072498] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 7a704222-ef62-43bc-add1-b91f5f86b850 not found, creating... [ 983.072819] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.073013] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.073169] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.073433] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.073604] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.073967] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.074184] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.074331] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.074622] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.074749] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.074911] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 7a704222-ef62-43bc-add1-b91f5f86b850 is going to be created. [ 983.102042] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.102251] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.102461] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.102969] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.103730] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.103730] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-7a704222-ef62-43bc-add1-b91f5f86b850" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.111787] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.112515] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.112515] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.112658] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.112711] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.113340] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port b837651b-8123-418b-ab05-4cd3f3f661b7 not found, creating... [ 983.113340] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.113573] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.113645] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.114026] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.114297] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.115259] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.115259] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.115259] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.115508] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.115670] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.115873] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: b837651b-8123-418b-ab05-4cd3f3f661b7 is going to be created. [ 983.139562] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.139854] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.140008] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.140388] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.140637] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.140892] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-b837651b-8123-418b-ab05-4cd3f3f661b7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.818339] env[65413]: INFO networking_nsxv3.common.synchronization [req-1fc2855c-c2fa-47b3-9e8e-b86ef28e6606 req-d0ad5d87-21e5-485e-a9b6-13dc043e63fc service nova] Enqueued Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGHEST for action security_group_rules [ 983.818511] env[65413]: INFO networking_nsxv3.common.synchronization [req-1fc2855c-c2fa-47b3-9e8e-b86ef28e6606 req-d0ad5d87-21e5-485e-a9b6-13dc043e63fc service nova] Enqueued Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGHEST for action security_group_members [ 983.818637] env[65413]: INFO networking_nsxv3.common.synchronization [req-1fc2855c-c2fa-47b3-9e8e-b86ef28e6606 req-d0ad5d87-21e5-485e-a9b6-13dc043e63fc service nova] Enqueued Resource ID: 7a704222-ef62-43bc-add1-b91f5f86b850 with Priority: HIGHEST for action port [ 983.818860] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGHEST for action security_group_rules [ 983.818985] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGHEST for action security_group_members [ 983.819085] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a704222-ef62-43bc-add1-b91f5f86b850 with Priority: HIGHEST for action port [ 983.819624] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edbcf595-e502-4812-b097-93b4e6d1355d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.819764] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.819973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.820163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.820258] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edbcf595-e502-4812-b097-93b4e6d1355d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.821601] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-edbcf595-e502-4812-b097-93b4e6d1355d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.821722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.821787] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.822011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.822166] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.822265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.822326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.822489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.822666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.822761] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edbcf595-e502-4812-b097-93b4e6d1355d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.823540] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a704222-ef62-43bc-add1-b91f5f86b850 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.823644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a704222-ef62-43bc-add1-b91f5f86b850" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.823742] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a704222-ef62-43bc-add1-b91f5f86b850" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.823851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a704222-ef62-43bc-add1-b91f5f86b850" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.824154] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a704222-ef62-43bc-add1-b91f5f86b850',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.924470] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 983.924717] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 deletion is rescheduled due to dependency. [ 983.925426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.925772] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bc7b7d78-f994-42d1-964f-0485a67466cc in Status: SUCCESS [ 983.925918] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bc7b7d78-f994-42d1-964f-0485a67466cc deletion is rescheduled due to dependency. [ 983.926041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.268586] env[65413]: INFO networking_nsxv3.common.synchronization [req-1cd45d23-a4d6-45bb-93dd-db9e6dc8205b req-dc22ab61-7959-4409-9c78-54cb8f4611a4 service nova] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_rules [ 984.268885] env[65413]: INFO networking_nsxv3.common.synchronization [req-1cd45d23-a4d6-45bb-93dd-db9e6dc8205b req-dc22ab61-7959-4409-9c78-54cb8f4611a4 service nova] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 984.268885] env[65413]: INFO networking_nsxv3.common.synchronization [req-1cd45d23-a4d6-45bb-93dd-db9e6dc8205b req-dc22ab61-7959-4409-9c78-54cb8f4611a4 service nova] Enqueued Resource ID: b837651b-8123-418b-ab05-4cd3f3f661b7 with Priority: HIGHEST for action port [ 984.269434] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_rules [ 984.269571] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 984.269688] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b837651b-8123-418b-ab05-4cd3f3f661b7 with Priority: HIGHEST for action port [ 984.271750] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.273136] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.273136] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.273136] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.273136] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.273964] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.274083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.276076] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-b837651b-8123-418b-ab05-4cd3f3f661b7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.276076] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b837651b-8123-418b-ab05-4cd3f3f661b7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.276076] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b837651b-8123-418b-ab05-4cd3f3f661b7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.276282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b837651b-8123-418b-ab05-4cd3f3f661b7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.276282] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b837651b-8123-418b-ab05-4cd3f3f661b7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.325483] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-edbcf595-e502-4812-b097-93b4e6d1355d taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.325618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.325830] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('edbcf595-e502-4812-b097-93b4e6d1355d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.330849] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7a704222-ef62-43bc-add1-b91f5f86b850 with status ACTIVE [ 984.334047] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.334047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.334047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.334047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.334047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.334047] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.334047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.334047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.334047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.334047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.334047] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.334047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.334047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.334047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.334047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.334047] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7a704222-ef62-43bc-add1-b91f5f86b850 is going to be updated. [ 984.355726] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.355726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.355726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.355726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.355726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.356030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a704222-ef62-43bc-add1-b91f5f86b850" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.400367] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 in Status: SUCCESS [ 984.400554] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 deletion is rescheduled due to dependency. [ 984.400670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.716565] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 984.716726] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 deletion is rescheduled due to dependency. [ 984.716850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.717019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.717355] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.717548] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.717665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.717731] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.717889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.718121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.718244] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 984.778361] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.778361] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.778528] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b837651b-8123-418b-ab05-4cd3f3f661b7 with status ACTIVE [ 984.778692] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.778757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.778857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.779057] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.779139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.779365] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.779492] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.779492] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.779624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.779702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.779940] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.780052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.780114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.780257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.780327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.780451] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b837651b-8123-418b-ab05-4cd3f3f661b7 is going to be updated. [ 984.813067] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.813292] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.813392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.813598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.814051] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.814261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b837651b-8123-418b-ab05-4cd3f3f661b7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.827913] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('edbcf595-e502-4812-b097-93b4e6d1355d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.220930] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.330401] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.330778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.330778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.330778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.330883] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.330972] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edbcf595-e502-4812-b097-93b4e6d1355d is going to be created. [ 985.372800] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.372800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.372800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.373098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.373185] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.383700] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edbcf595-e502-4812-b097-93b4e6d1355d in Status: UNINITIALIZED for 2s [ 985.723925] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.172861] env[65413]: INFO networking_nsxv3.common.synchronization [None req-7e56330d-da7d-4a04-919a-20f6446e7474 None None] Enqueued Resource ID: 0c48a682-db17-4895-afef-d8724d99d11a with Priority: HIGHEST for action port [ 986.173077] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c48a682-db17-4895-afef-d8724d99d11a with Priority: HIGHEST for action port [ 986.174026] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c48a682-db17-4895-afef-d8724d99d11a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.174026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c48a682-db17-4895-afef-d8724d99d11a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.174026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c48a682-db17-4895-afef-d8724d99d11a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.174026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c48a682-db17-4895-afef-d8724d99d11a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.174250] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c48a682-db17-4895-afef-d8724d99d11a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.228103] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.228103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.228103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.229643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.229643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.229643] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be updated. [ 986.277574] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.277795] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.277851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.278255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.278501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.296630] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 986.677022] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0c48a682-db17-4895-afef-d8724d99d11a [ 986.677022] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.677022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.677022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.677679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.677679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.677679] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0c48a682-db17-4895-afef-d8724d99d11a already deleted. [ 986.677679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c48a682-db17-4895-afef-d8724d99d11a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.395113] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edbcf595-e502-4812-b097-93b4e6d1355d in Status: SUCCESS [ 987.395336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.395505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.395727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.395922] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.396122] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.396122] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.396261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.396337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.396418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.396507] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('edbcf595-e502-4812-b097-93b4e6d1355d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.899476] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('edbcf595-e502-4812-b097-93b4e6d1355d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.309032] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 988.309032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.309267] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.309308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.309511] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.309629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.309694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.309940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.310053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.310126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.310214] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.402297] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for edbcf595-e502-4812-b097-93b4e6d1355d: rpc.has_security_group_logging(os_id): False [ 988.425362] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.425584] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.425584] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.425794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.425884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.426148] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.426250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.426330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.426489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.426565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.426653] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edbcf595-e502-4812-b097-93b4e6d1355d is going to be created. [ 988.515666] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.515666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.515666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.515963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.516179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.530418] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edbcf595-e502-4812-b097-93b4e6d1355d in Status: IN_PROGRESS for 2s [ 988.636112] env[65413]: INFO networking_nsxv3.common.synchronization [None req-e7a4a216-58fe-4f02-90dd-e842c579899d None None] Enqueued Resource ID: 5e70609f-d040-4c6e-89cf-10f832dcdaad with Priority: HIGHEST for action port [ 988.636585] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e70609f-d040-4c6e-89cf-10f832dcdaad with Priority: HIGHEST for action port [ 988.636927] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e70609f-d040-4c6e-89cf-10f832dcdaad taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.636927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e70609f-d040-4c6e-89cf-10f832dcdaad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.636927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e70609f-d040-4c6e-89cf-10f832dcdaad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.637305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e70609f-d040-4c6e-89cf-10f832dcdaad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.637401] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e70609f-d040-4c6e-89cf-10f832dcdaad',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.815024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.815024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.815024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.815024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.815024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.815024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.815024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.815024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.815024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.815024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.815024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.815024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.815024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.815024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.815024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.815024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.815741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.815741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.815741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.815741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.815741] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.139956] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e70609f-d040-4c6e-89cf-10f832dcdaad [ 989.140284] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.140363] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.140454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.140725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.140879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.141041] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e70609f-d040-4c6e-89cf-10f832dcdaad already deleted. [ 989.141141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e70609f-d040-4c6e-89cf-10f832dcdaad" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.319344] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abda67a6-20b2-4d8b-8a37-701a11fb0d75: rpc.has_security_group_logging(os_id): False [ 989.338031] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.338328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.338381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.338895] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.338895] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.339192] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.339406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.339512] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.339767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.339894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.340212] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.340471] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.340584] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.340805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.340923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.341735] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.341735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.341735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.341735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.341970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.342121] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be updated. [ 989.365911] env[65413]: INFO networking_nsxv3.common.synchronization [None req-3749dfb0-bfbb-4aac-9623-183e49c992b5 tempest-ServerActionsV293TestJSON-598190869 tempest-ServerActionsV293TestJSON-598190869-project-member] Enqueued Resource ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 with Priority: HIGHEST for action security_group_rules [ 989.366862] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 with Priority: HIGHEST for action security_group_rules [ 989.368325] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.368325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.368325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.368325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.368325] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('065563e4-03b1-4f50-9075-8d4bf2c3fb60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.429444] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.429444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.429444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.429729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.429878] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.446777] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 989.481655] env[65413]: INFO networking_nsxv3.common.synchronization [None req-99250792-de95-466b-a9a6-573cb301deb2 tempest-ServerActionsV293TestJSON-598190869 tempest-ServerActionsV293TestJSON-598190869-project-member] Enqueued Resource ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 with Priority: HIGHEST for action security_group_rules [ 989.481655] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 with Priority: HIGHEST for action security_group_rules [ 989.481655] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.481655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.894329] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.894329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.894329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.894329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.894329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.894329] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 already deleted. [ 989.894329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.894329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.894329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.894329] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('065563e4-03b1-4f50-9075-8d4bf2c3fb60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.420656] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.421381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.421381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.421381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.421381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.421507] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 already deleted. [ 990.422140] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.549456] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edbcf595-e502-4812-b097-93b4e6d1355d in Status: SUCCESS [ 990.549716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.149268] env[65413]: INFO networking_nsxv3.common.synchronization [None req-54462cb5-b825-431c-83e3-16e72cc7b197 tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 991.149889] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 991.150241] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.150466] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.150537] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.150969] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.150969] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.151102] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.151102] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.151383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.151474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.151566] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.462972] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 991.462972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.655139] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.059417] env[65413]: INFO networking_nsxv3.common.synchronization [req-57309c63-78ac-457b-8e5e-7a3cfacc3b69 req-f0ff9133-50e1-45b8-b086-0142986a49b1 tempest-DeleteServersTestJSON-2008533967 tempest-DeleteServersTestJSON-2008533967-project-member] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 992.059966] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 992.060271] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.060434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.064033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.064318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.064497] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.064611] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.064671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.064830] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.064932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.065034] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.157823] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.517982] env[65413]: INFO networking_nsxv3.common.synchronization [req-c9e2dcaf-dd6c-4b74-b8a2-c1fb6bf6ac03 req-ce8bcc5e-14e5-43cd-a4af-1b9f2b6dd6c1 tempest-ImagesTestJSON-1309992501 tempest-ImagesTestJSON-1309992501-project-member] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 992.517982] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 992.518261] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.518261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.518261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.518435] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.518560] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.518703] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.518776] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.519090] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.519090] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.519636] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.571031] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.571031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.571031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.571031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.571031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.571031] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.571031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.571031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.571031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.571477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.571477] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 992.601475] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.601682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.601758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.602014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.602181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.611788] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 992.660913] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.661110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.661148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.661370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.661468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.661565] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be updated. [ 992.697814] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.698336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.698620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.698915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.699274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.710677] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 992.908107] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-954 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.908445] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.908871] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.909091] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.909396] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.909618] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.909777] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.910065] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.910256] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.910498] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.910648] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 992.910792] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 992.910963] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 992.911164] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 992.911309] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 992.911487] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 992.933950] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 992.934208] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 992.934359] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 992.934743] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-954" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.935185] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-9c562e89-cbf6-4aad-9854-5c2c4198bd7f taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.935407] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-9c562e89-cbf6-4aad-9854-5c2c4198bd7f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.935552] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-9c562e89-cbf6-4aad-9854-5c2c4198bd7f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.935931] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-9c562e89-cbf6-4aad-9854-5c2c4198bd7f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.936189] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c562e89-cbf6-4aad-9854-5c2c4198bd7f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.025031] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.025031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.025031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.025031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.025031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.025031] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.025031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.025031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.025031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.025031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.025031] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 993.055170] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.055520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.055520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.055899] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.056478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.067489] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 993.438414] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.440867] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.440867] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.440867] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.440867] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.440867] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 9c562e89-cbf6-4aad-9854-5c2c4198bd7f not found, creating... [ 993.440867] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.440867] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.440867] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.440867] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.440867] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.441363] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.441363] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.441363] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.441363] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.441363] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.441718] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 9c562e89-cbf6-4aad-9854-5c2c4198bd7f is going to be created. [ 993.466207] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.466207] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.466207] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.466545] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.466707] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.466949] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-9c562e89-cbf6-4aad-9854-5c2c4198bd7f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.205713] env[65413]: INFO networking_nsxv3.common.synchronization [req-c9e2dcaf-dd6c-4b74-b8a2-c1fb6bf6ac03 req-591a3527-6959-48d0-9b14-649f1bc6c2ee service nova] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_rules [ 994.206180] env[65413]: INFO networking_nsxv3.common.synchronization [req-c9e2dcaf-dd6c-4b74-b8a2-c1fb6bf6ac03 req-591a3527-6959-48d0-9b14-649f1bc6c2ee service nova] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 994.206180] env[65413]: INFO networking_nsxv3.common.synchronization [req-c9e2dcaf-dd6c-4b74-b8a2-c1fb6bf6ac03 req-591a3527-6959-48d0-9b14-649f1bc6c2ee service nova] Enqueued Resource ID: 9c562e89-cbf6-4aad-9854-5c2c4198bd7f with Priority: HIGHEST for action port [ 994.206727] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_rules [ 994.206879] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 994.207017] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c562e89-cbf6-4aad-9854-5c2c4198bd7f with Priority: HIGHEST for action port [ 994.212056] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.212226] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.212350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.212513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.212598] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.213682] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.216987] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.216987] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c562e89-cbf6-4aad-9854-5c2c4198bd7f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.216987] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c562e89-cbf6-4aad-9854-5c2c4198bd7f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.218228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c562e89-cbf6-4aad-9854-5c2c4198bd7f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.218471] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c562e89-cbf6-4aad-9854-5c2c4198bd7f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.218631] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c562e89-cbf6-4aad-9854-5c2c4198bd7f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.622219] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 994.622395] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 deletion is rescheduled due to dependency. [ 994.625376] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.723166] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c562e89-cbf6-4aad-9854-5c2c4198bd7f with status ACTIVE [ 994.723166] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.723166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.723166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.723166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.723166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.723166] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.723166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.723166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.723166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.723166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.723166] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.723166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.723694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.723694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.723694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.723694] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c562e89-cbf6-4aad-9854-5c2c4198bd7f is going to be updated. [ 994.725351] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.725530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.726511] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 994.726691] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.752023] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.752023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.752023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.752023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.752023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.752023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c562e89-cbf6-4aad-9854-5c2c4198bd7f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.803000] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.803223] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.803347] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.803662] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.803919] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.804207] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.804407] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.804627] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.804767] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.805127] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.805242] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.805347] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.805452] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.805558] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.805723] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.805831] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.851360] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.851569] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 994.851707] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.851884] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.852297] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-53c30ca3-fef4-456f-b1fe-3441a86de56b taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.852479] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-53c30ca3-fef4-456f-b1fe-3441a86de56b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.852601] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-53c30ca3-fef4-456f-b1fe-3441a86de56b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.852942] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-53c30ca3-fef4-456f-b1fe-3441a86de56b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.853080] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53c30ca3-fef4-456f-b1fe-3441a86de56b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.080988] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 995.080988] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 deletion is rescheduled due to dependency. [ 995.080988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.080988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.081472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.081472] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.081472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.081600] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.081704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.082040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.082040] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.356861] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.357129] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.357236] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.357525] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.357662] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.357816] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 53c30ca3-fef4-456f-b1fe-3441a86de56b not found, creating... [ 995.358113] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.358276] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.358391] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.358605] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.358772] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.359078] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.359241] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.359374] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.359676] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.359873] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.360163] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 53c30ca3-fef4-456f-b1fe-3441a86de56b is going to be created. [ 995.381012] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.381281] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.381411] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.381699] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.381954] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.382178] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-53c30ca3-fef4-456f-b1fe-3441a86de56b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.585621] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.971648] env[65413]: INFO networking_nsxv3.common.synchronization [None req-0171749f-13f2-49ac-b193-72927986b628 None None] Enqueued Resource ID: 18f81c9f-99fc-4da1-b424-9d39f11c9ec3 with Priority: HIGHEST for action port [ 995.972161] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18f81c9f-99fc-4da1-b424-9d39f11c9ec3 with Priority: HIGHEST for action port [ 995.972534] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-18f81c9f-99fc-4da1-b424-9d39f11c9ec3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.972664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18f81c9f-99fc-4da1-b424-9d39f11c9ec3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.972733] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18f81c9f-99fc-4da1-b424-9d39f11c9ec3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.973037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18f81c9f-99fc-4da1-b424-9d39f11c9ec3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.973100] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18f81c9f-99fc-4da1-b424-9d39f11c9ec3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.087195] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.162107] env[65413]: INFO networking_nsxv3.common.synchronization [req-6d2d2344-d1c5-45c6-9526-0c2db59bc8bd req-ebb19b04-b915-4d9d-9b81-31de51632ffa service nova] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_rules [ 996.162107] env[65413]: INFO networking_nsxv3.common.synchronization [req-6d2d2344-d1c5-45c6-9526-0c2db59bc8bd req-ebb19b04-b915-4d9d-9b81-31de51632ffa service nova] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 996.162107] env[65413]: INFO networking_nsxv3.common.synchronization [req-6d2d2344-d1c5-45c6-9526-0c2db59bc8bd req-ebb19b04-b915-4d9d-9b81-31de51632ffa service nova] Enqueued Resource ID: 53c30ca3-fef4-456f-b1fe-3441a86de56b with Priority: HIGHEST for action port [ 996.163018] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_rules [ 996.165973] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 996.165973] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53c30ca3-fef4-456f-b1fe-3441a86de56b with Priority: HIGHEST for action port [ 996.165973] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.165973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.165973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.165973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.165973] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.165973] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.165973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.165973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.165973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.165973] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.165973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.165973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.166530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.166530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.166530] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.168179] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-53c30ca3-fef4-456f-b1fe-3441a86de56b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.168179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53c30ca3-fef4-456f-b1fe-3441a86de56b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.168179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53c30ca3-fef4-456f-b1fe-3441a86de56b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.168179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53c30ca3-fef4-456f-b1fe-3441a86de56b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.168179] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53c30ca3-fef4-456f-b1fe-3441a86de56b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.476417] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18f81c9f-99fc-4da1-b424-9d39f11c9ec3 [ 996.476718] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.477965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.478066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.478272] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.478370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.478510] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18f81c9f-99fc-4da1-b424-9d39f11c9ec3 already deleted. [ 996.478629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18f81c9f-99fc-4da1-b424-9d39f11c9ec3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.589577] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.589741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.589838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.590255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.590255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.590421] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 996.629529] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.629703] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.629806] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.630093] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.630282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.644013] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 996.671532] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.672978] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.673511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.673511] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 53c30ca3-fef4-456f-b1fe-3441a86de56b with status ACTIVE [ 996.673511] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.673666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.673666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.673862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.673953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.674156] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.674245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.674341] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.674531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.674611] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.674799] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.674889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.679419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.679419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.679419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.679419] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 53c30ca3-fef4-456f-b1fe-3441a86de56b is going to be updated. [ 996.711121] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.711495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.711569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.711809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.712034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.712243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53c30ca3-fef4-456f-b1fe-3441a86de56b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.180777] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.685455] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.685455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.685455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.685455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.685455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.685455] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be updated. [ 997.712676] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.712930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.712930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.713212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.713362] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.722781] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 998.116226] env[65413]: INFO networking_nsxv3.common.synchronization [None req-525b6265-af40-4503-a9d3-f44585b8e7ab None None] Enqueued Resource ID: 68a0b063-6765-4b68-b485-eebc09f30848 with Priority: HIGHEST for action port [ 998.116536] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68a0b063-6765-4b68-b485-eebc09f30848 with Priority: HIGHEST for action port [ 998.116902] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-68a0b063-6765-4b68-b485-eebc09f30848 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.121172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68a0b063-6765-4b68-b485-eebc09f30848" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.121172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68a0b063-6765-4b68-b485-eebc09f30848" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.121172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68a0b063-6765-4b68-b485-eebc09f30848" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.121388] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68a0b063-6765-4b68-b485-eebc09f30848',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.626404] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 68a0b063-6765-4b68-b485-eebc09f30848 [ 998.627351] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.627530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.627604] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.627838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.627928] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.628061] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:68a0b063-6765-4b68-b485-eebc09f30848 already deleted. [ 998.628210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68a0b063-6765-4b68-b485-eebc09f30848" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.656425] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 998.657367] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.657888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.658144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.658348] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.658474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.658541] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.658702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.658783] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.658868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.658956] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.165886] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.169084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.169084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.169084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.169084] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.169084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.169084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.169084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.169084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.169084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.169084] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.169084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.169084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.169084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.169084] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.169084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.169084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.169084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.169084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.169782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.169782] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.670798] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 650f4003-0da8-43a0-bfde-c7d15e589861: rpc.has_security_group_logging(os_id): False [ 999.692798] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.693053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.693255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.693435] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.693560] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.693852] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.693957] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.694067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.694304] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.694375] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.694574] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.694684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.694738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.694905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.694997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.695469] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.695605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.695672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.695821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.695917] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.697755] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 999.732863] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 999.733223] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.733431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.733658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.733859] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.734022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.734099] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.734222] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.734364] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.734514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.734665] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.761707] env[65413]: INFO networking_nsxv3.common.synchronization [None req-1339870c-57d2-4ce2-ba5f-fdd1952e1c8d tempest-ServerActionsTestOtherA-276981019 tempest-ServerActionsTestOtherA-276981019-project-member] Enqueued Resource ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 with Priority: HIGHEST for action security_group_rules [ 999.762388] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 with Priority: HIGHEST for action security_group_rules [ 999.762644] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.762764] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.762832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.763317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.763410] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.769521] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.769653] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.769704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.769993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.770397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.785943] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 999.898459] env[65413]: INFO networking_nsxv3.common.synchronization [None req-503174e7-44d4-4a85-b42c-8e950b897c55 tempest-ServerActionsTestOtherA-276981019 tempest-ServerActionsTestOtherA-276981019-project-member] Enqueued Resource ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 with Priority: HIGHEST for action security_group_rules [ 999.899089] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 with Priority: HIGHEST for action security_group_rules [ 999.899415] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.899521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.237672] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.238133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.238133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.238133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.240016] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.240016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.240016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.240016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.240016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.240016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.240016] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.240016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.240016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.240016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.240016] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.240016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.240016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.240801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.240801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.240801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.240801] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.286526] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.286526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.286526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.286526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.286526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.286526] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 already deleted. [ 1000.286526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.286526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.286526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.286526] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.744319] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abda67a6-20b2-4d8b-8a37-701a11fb0d75: rpc.has_security_group_logging(os_id): False [ 1000.763024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.763227] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.763421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.763534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.763857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.763857] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.763990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.763990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.764138] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.764212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.764397] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.765054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.765054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.765054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.765054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.765054] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.765054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.765054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.765380] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.765380] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.765380] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be updated. [ 1000.808110] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.808336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.808439] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.808701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.808818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.808942] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 already deleted. [ 1000.809324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.829850] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.830094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.830151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.830338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.830484] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.844816] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 1001.803619] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 1001.803939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.534651] env[65413]: INFO networking_nsxv3.common.synchronization [req-77505cb3-9ebb-43db-af35-98f49e215b48 req-76dcf919-7e8d-40c7-bb62-74751a4edc3a tempest-ServerActionsTestOtherB-69504015 tempest-ServerActionsTestOtherB-69504015-project-member] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1002.535514] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1002.535780] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.535920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.536025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.536315] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.536506] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.536631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.536705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.536945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.537063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.537178] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.861976] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 1002.862418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.041725] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.041725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.041725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.041725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.065098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.065098] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.065098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.065098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.065098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.065503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.065503] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded is going to be updated. [ 1003.094818] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.094987] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.095066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.095251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.095389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.105080] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: IN_PROGRESS for 2s [ 1003.388634] env[65413]: INFO networking_nsxv3.common.synchronization [req-c6637e80-b39e-4484-9a39-394bf3766d19 req-ab1a2685-b25a-44f5-8296-6f10b7ba499b tempest-ServerActionsTestJSON-1087044681 tempest-ServerActionsTestJSON-1087044681-project-member] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 1003.389277] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 1003.389733] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.390221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.390341] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.390666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.390848] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.390955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.391071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.391176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.391261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.391351] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.722421] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-508 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.722636] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.722758] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.723043] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.723335] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.723487] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.723600] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.723812] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.723953] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.724250] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.724361] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1003.724462] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1003.724565] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1003.724669] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1003.724770] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1003.724897] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1003.744985] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1003.745207] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1003.745347] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1003.745525] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-508" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.745850] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.746045] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.746205] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.746490] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.746620] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.894903] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.895189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.895189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.895362] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.917348] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.917805] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.917805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.917805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.918025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.918187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.918187] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef is going to be updated. [ 1003.943193] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.943357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.943405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.943608] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.943744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.954665] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: IN_PROGRESS for 2s [ 1004.053993] env[65413]: INFO networking_nsxv3.common.synchronization [req-e2108609-3445-48d4-8fe0-2a17355eeb68 req-d65a6870-0388-4e6c-ac9d-af265034c679 tempest-ServerDiskConfigTestJSON-938124936 tempest-ServerDiskConfigTestJSON-938124936-project-member] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1004.054524] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1004.055129] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.055129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.055129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.055344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.055382] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.055470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.055530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.055674] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.055758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.055850] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.249065] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.249330] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.249472] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.249725] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.249877] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.250174] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.250330] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.250502] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.250744] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.250835] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.251112] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.251266] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.251375] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.251575] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.251707] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.251857] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd is going to be updated. [ 1004.279738] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.280011] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.280141] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.280456] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.280713] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.280970] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.558462] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.558705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.558818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.559139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.559261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.559552] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.559716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.559835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.560092] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.560198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.560301] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 1004.595644] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.595835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.595835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.596075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.596221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.610828] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 1004.984126] env[65413]: INFO networking_nsxv3.common.synchronization [req-c1fdca6d-dfd6-4679-bdd0-9b523094709a req-b9aee63a-bcd5-4bf7-a053-1177077a7f4c service nova] Enqueued Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_rules [ 1004.984436] env[65413]: INFO networking_nsxv3.common.synchronization [req-c1fdca6d-dfd6-4679-bdd0-9b523094709a req-b9aee63a-bcd5-4bf7-a053-1177077a7f4c service nova] Enqueued Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_members [ 1004.984436] env[65413]: INFO networking_nsxv3.common.synchronization [req-c1fdca6d-dfd6-4679-bdd0-9b523094709a req-b9aee63a-bcd5-4bf7-a053-1177077a7f4c service nova] Enqueued Resource ID: c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd with Priority: HIGHEST for action port [ 1004.985017] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_rules [ 1004.985162] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_members [ 1004.985263] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd with Priority: HIGHEST for action port [ 1004.985548] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.985669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.985737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.986008] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.986102] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.987678] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.987840] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.987902] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.988091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.988289] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.988407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.988470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.988636] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.988719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.988810] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.992592] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.992780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.992780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.993035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.993035] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.122915] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: SUCCESS [ 1005.123158] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded deletion is rescheduled due to dependency. [ 1005.123253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.495617] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.495810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.496289] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.497268] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd with status ACTIVE [ 1005.497523] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.497660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.497730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.497983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.498093] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.498281] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.498379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.498576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.499467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.499467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.499467] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.499467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.499467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.499801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.499801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.499801] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd is going to be updated. [ 1005.534126] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.534126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.534126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.534126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.534126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.534126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c51b2fcd-ba0d-4df7-87fe-6cfff9c13bbd" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.965147] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: SUCCESS [ 1005.965380] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef deletion is rescheduled due to dependency. [ 1005.965520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.002085] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.504595] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.504809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.504856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.505208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.505344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.505486] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e is going to be updated. [ 1006.536356] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.536598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.536665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.536949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.537176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.550322] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: IN_PROGRESS for 2s [ 1006.621357] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 1006.621590] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 deletion is rescheduled due to dependency. [ 1006.621674] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.792389] env[65413]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1006.792632] env[65413]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1007.574386] env[65413]: INFO networking_nsxv3.common.synchronization [req-e07f79a1-31a4-48ba-889b-37e7ae500620 req-899fb485-1bd7-4cb6-9a33-1e8b4e5b05dc tempest-ServerPasswordTestJSON-984186487 tempest-ServerPasswordTestJSON-984186487-project-member] Enqueued Resource ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 with Priority: HIGHEST for action security_group_members [ 1007.574933] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 with Priority: HIGHEST for action security_group_members [ 1007.575255] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9d5ed73-228a-4ead-afe1-ed95ca323320 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.575372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.575427] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.575684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.575838] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.575936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.575995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.576155] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.576237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.576326] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9d5ed73-228a-4ead-afe1-ed95ca323320',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.875759] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-573 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.875960] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-573" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.876088] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-573" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.876419] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-573" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.876683] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.876831] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.876943] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.877185] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.877358] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.877522] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1007.877716] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1007.877836] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1007.877944] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1007.878090] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1007.878203] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1007.878340] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1007.899406] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1007.899530] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1007.899644] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1007.899780] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-573" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.900263] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-163d39d8-f1ec-423a-a582-3972ebf6ea39 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.900729] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-163d39d8-f1ec-423a-a582-3972ebf6ea39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.900729] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-163d39d8-f1ec-423a-a582-3972ebf6ea39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.900947] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-163d39d8-f1ec-423a-a582-3972ebf6ea39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.901042] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('163d39d8-f1ec-423a-a582-3972ebf6ea39',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.078892] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.079141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.079210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.079598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.079715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.079962] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.080114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.080189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.080388] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.080490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.080596] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 already deleted. [ 1008.080706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.404983] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.405256] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.405398] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.405671] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.405809] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.405954] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 163d39d8-f1ec-423a-a582-3972ebf6ea39 not found, creating... [ 1008.408102] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.408102] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.408102] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.408102] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.408102] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.408102] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.408102] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.408102] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.408102] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.408102] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.409448] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 163d39d8-f1ec-423a-a582-3972ebf6ea39 is going to be created. [ 1008.428860] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.429097] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.429220] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.429486] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.429709] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.429921] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-163d39d8-f1ec-423a-a582-3972ebf6ea39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.565798] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: SUCCESS [ 1008.566233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.566453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.569199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.569199] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.569199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.569199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.569199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.569199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.569199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.569199] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.075296] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.075805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.075805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.076056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.076238] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.076408] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.076510] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.076827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.076888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.077019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.077217] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.077350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.077495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.077687] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.077879] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.077996] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.078094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.078269] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.078378] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.078488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.078660] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.196451] env[65413]: INFO networking_nsxv3.common.synchronization [req-e07f79a1-31a4-48ba-889b-37e7ae500620 req-a87de03c-8b25-442c-bbd4-3eabf44b05b8 service nova] Enqueued Resource ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 with Priority: HIGHEST for action security_group_rules [ 1009.196688] env[65413]: INFO networking_nsxv3.common.synchronization [req-e07f79a1-31a4-48ba-889b-37e7ae500620 req-a87de03c-8b25-442c-bbd4-3eabf44b05b8 service nova] Enqueued Resource ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 with Priority: HIGHEST for action security_group_members [ 1009.196886] env[65413]: INFO networking_nsxv3.common.synchronization [req-e07f79a1-31a4-48ba-889b-37e7ae500620 req-a87de03c-8b25-442c-bbd4-3eabf44b05b8 service nova] Enqueued Resource ID: 163d39d8-f1ec-423a-a582-3972ebf6ea39 with Priority: HIGHEST for action port [ 1009.197754] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 with Priority: HIGHEST for action security_group_rules [ 1009.197953] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 with Priority: HIGHEST for action security_group_members [ 1009.198102] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 163d39d8-f1ec-423a-a582-3972ebf6ea39 with Priority: HIGHEST for action port [ 1009.198490] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9d5ed73-228a-4ead-afe1-ed95ca323320 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.198682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.198790] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.199177] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.199296] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9d5ed73-228a-4ead-afe1-ed95ca323320',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.201210] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9d5ed73-228a-4ead-afe1-ed95ca323320 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.201210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.201210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.201210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.201615] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.201615] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.201615] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.201737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.202274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.202425] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9d5ed73-228a-4ead-afe1-ed95ca323320',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.204059] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-163d39d8-f1ec-423a-a582-3972ebf6ea39 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.204233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-163d39d8-f1ec-423a-a582-3972ebf6ea39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.205028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-163d39d8-f1ec-423a-a582-3972ebf6ea39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.205028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-163d39d8-f1ec-423a-a582-3972ebf6ea39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.205028] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('163d39d8-f1ec-423a-a582-3972ebf6ea39',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.581407] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e: rpc.has_security_group_logging(os_id): False [ 1009.608999] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.608999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.608999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.608999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.608999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.608999] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.608999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.608999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.608999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.608999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.608999] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.610065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.610065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.610065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.610065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.610065] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.610065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.610065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.610414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.610414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.610533] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e is going to be updated. [ 1009.688940] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.689122] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.689164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.689384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.689529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.704422] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f9d5ed73-228a-4ead-afe1-ed95ca323320',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.706283] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 163d39d8-f1ec-423a-a582-3972ebf6ea39 with status ACTIVE [ 1009.706721] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.706970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.707111] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.707377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.707524] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.708347] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.708347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.708347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.708347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.708347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.708597] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.708597] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.708784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.708901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.708941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.709080] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 163d39d8-f1ec-423a-a582-3972ebf6ea39 is going to be updated. [ 1009.710700] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9d5ed73-228a-4ead-afe1-ed95ca323320 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.710700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.750526] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: IN_PROGRESS for 2s [ 1009.765092] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.765092] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.765402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.765539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.765841] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.766154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-163d39d8-f1ec-423a-a582-3972ebf6ea39" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.206978] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f9d5ed73-228a-4ead-afe1-ed95ca323320',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.276650] env[65413]: INFO networking_nsxv3.common.synchronization [req-0ccfa9db-e52c-4ed8-b2e0-e190ce46ffb3 req-47f499eb-c8af-4ec8-aa36-7c5247fae94c tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 1010.277611] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 1010.278140] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.278332] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.278485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.278813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.279086] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.279302] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.279479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.279595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.279754] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.279842] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.713029] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.713029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.713029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.713029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.713029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.713029] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 is going to be created. [ 1010.743641] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.743897] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.744078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.744490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.744763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.756936] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 in Status: UNINITIALIZED for 2s [ 1010.783164] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.036757] env[65413]: INFO networking_nsxv3.common.synchronization [req-255b28a9-122b-44c2-b345-022617e8227a req-fa1f32a0-ce57-489f-81fa-784c5df97189 tempest-ServerActionsTestOtherA-276981019 tempest-ServerActionsTestOtherA-276981019-project-member] Enqueued Resource ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 with Priority: HIGHEST for action security_group_members [ 1011.037127] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 with Priority: HIGHEST for action security_group_members [ 1011.037464] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.037601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.037669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.037953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.038152] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.038259] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.038318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.038475] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.038558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.038674] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.129923] env[65413]: INFO networking_nsxv3.common.synchronization [None req-eb6d8bd3-fc81-401b-bf92-41df4333cb5a tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 1011.131029] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 1011.131263] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.131372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.284962] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.541782] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.541782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.541984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.542275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.542275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.542489] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.542564] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.542654] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.542829] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.542903] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.543025] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 already deleted. [ 1011.543101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.549256] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-598 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.549448] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.549547] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.549849] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.550154] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.550346] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.550439] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.550674] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.550824] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.551989] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.551989] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1011.551989] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1011.551989] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1011.551989] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1011.551989] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1011.551989] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1011.587824] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1011.588065] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.036 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1011.588252] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1011.588443] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.588861] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-0721723b-5150-492b-a173-0c5069696cfe taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.589157] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-0721723b-5150-492b-a173-0c5069696cfe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.589403] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-0721723b-5150-492b-a173-0c5069696cfe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.589793] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-0721723b-5150-492b-a173-0c5069696cfe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.589934] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0721723b-5150-492b-a173-0c5069696cfe',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.769587] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: SUCCESS [ 1011.769815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.789236] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.789438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.789438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.789610] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.789724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.789772] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be updated. [ 1011.826909] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.826909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.826909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.826909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.826909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.838728] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 1012.093130] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.093517] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.093601] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.094242] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.094242] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.094242] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 0721723b-5150-492b-a173-0c5069696cfe not found, creating... [ 1012.094546] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.094636] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.094688] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.094905] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.095084] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.095412] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.095979] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.095979] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.095979] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.096212] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.096212] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 0721723b-5150-492b-a173-0c5069696cfe is going to be created. [ 1012.121499] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.121835] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.122082] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.122442] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.122705] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.123038] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-0721723b-5150-492b-a173-0c5069696cfe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.768839] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 in Status: SUCCESS [ 1012.768839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.768839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.768839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.768839] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.768839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.768839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.768839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.768839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.768839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.768839] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f9d5ed73-228a-4ead-afe1-ed95ca323320',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.850365] env[65413]: INFO networking_nsxv3.common.synchronization [req-255b28a9-122b-44c2-b345-022617e8227a req-19f26505-1e89-461b-af0e-f91684c8bade service nova] Enqueued Resource ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 with Priority: HIGHEST for action security_group_rules [ 1012.850625] env[65413]: INFO networking_nsxv3.common.synchronization [req-255b28a9-122b-44c2-b345-022617e8227a req-19f26505-1e89-461b-af0e-f91684c8bade service nova] Enqueued Resource ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 with Priority: HIGHEST for action security_group_members [ 1012.850718] env[65413]: INFO networking_nsxv3.common.synchronization [req-255b28a9-122b-44c2-b345-022617e8227a req-19f26505-1e89-461b-af0e-f91684c8bade service nova] Enqueued Resource ID: 0721723b-5150-492b-a173-0c5069696cfe with Priority: HIGHEST for action port [ 1012.851257] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 with Priority: HIGHEST for action security_group_rules [ 1012.851397] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 with Priority: HIGHEST for action security_group_members [ 1012.851515] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0721723b-5150-492b-a173-0c5069696cfe with Priority: HIGHEST for action port [ 1012.851930] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.852110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.852159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.852643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.852732] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.854240] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.854367] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.854437] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.854658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.854754] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.854850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.854910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.855070] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.855153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.855242] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.861566] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0721723b-5150-492b-a173-0c5069696cfe taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.861566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0721723b-5150-492b-a173-0c5069696cfe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.861566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0721723b-5150-492b-a173-0c5069696cfe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.861566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0721723b-5150-492b-a173-0c5069696cfe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.861566] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0721723b-5150-492b-a173-0c5069696cfe',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.270614] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9d5ed73-228a-4ead-afe1-ed95ca323320 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.270901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.270901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.271047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.271137] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.271234] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.271297] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.271441] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.271524] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.271614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.271795] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9d5ed73-228a-4ead-afe1-ed95ca323320 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.271953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.271953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.272167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.272812] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.272812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.272812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.272812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.272812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.273209] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.273209] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f9d5ed73-228a-4ead-afe1-ed95ca323320',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.359212] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.360344] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.360463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.360620] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0721723b-5150-492b-a173-0c5069696cfe with status ACTIVE [ 1013.360773] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.360880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.360945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.362191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.362396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.362684] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.362843] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.362941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.363232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.363361] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.363686] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.364339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.364339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.364339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.364339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.364631] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0721723b-5150-492b-a173-0c5069696cfe is going to be updated. [ 1013.387780] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.387960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.388035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.388231] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.388369] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.388586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0721723b-5150-492b-a173-0c5069696cfe" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.775612] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f9d5ed73-228a-4ead-afe1-ed95ca323320: rpc.has_security_group_logging(os_id): False [ 1013.798322] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.798322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.798322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.798322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.798322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.798322] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.798610] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.798610] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.799198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.799198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.799198] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.799690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.799690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.799690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.799690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.800138] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.800138] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.800138] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.800716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.800716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.800716] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 is going to be created. [ 1013.854143] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 1013.854400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.854651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.854908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.855130] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.855309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.855477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.855551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.855629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.855771] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.866875] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.867149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.867149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.867331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.867735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.868997] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.886630] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 in Status: IN_PROGRESS for 2s [ 1014.358064] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.358287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.358372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.358613] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.358698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.358969] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.359101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.359149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.359312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.359392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.359486] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be updated. [ 1014.371844] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.372200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.372200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.372592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.372592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.372780] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 is going to be created. [ 1014.394931] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.395127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.395175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.395380] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.395521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.405877] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.406125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.406125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.406452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.406638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.408331] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 1014.420708] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 in Status: UNINITIALIZED for 2s [ 1014.664939] env[65413]: INFO networking_nsxv3.common.synchronization [req-040a8dc2-301f-4b6f-85c4-0dbd28d62b55 req-738796d0-5300-464f-96c1-5aa12ad7c179 tempest-DeleteServersTestJSON-2008533967 tempest-DeleteServersTestJSON-2008533967-project-member] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 1014.665546] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 1014.665989] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.666183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.666226] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.666450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.666803] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.666803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.666803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.667042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.667138] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.667260] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.080295] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-586 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.080295] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.080295] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.080657] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.083173] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.083173] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.083173] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.083173] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.083173] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.083487] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.084297] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.084378] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.084513] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.084626] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.084779] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.085140] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.111085] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.111085] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1015.111309] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.111376] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-586" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.111714] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-9236d87e-195c-4d29-9a5d-9308481092bc taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.112555] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-9236d87e-195c-4d29-9a5d-9308481092bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.112555] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-9236d87e-195c-4d29-9a5d-9308481092bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.113670] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-9236d87e-195c-4d29-9a5d-9308481092bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.113670] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9236d87e-195c-4d29-9a5d-9308481092bc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.171206] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.171418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.171499] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.171756] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.171839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.172117] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.172219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.172283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.172480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.172564] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.172716] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 1015.209189] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.209189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.209189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.209189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.209189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.229025] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 1015.620199] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.620199] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.620199] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.620622] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.620788] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.621639] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 9236d87e-195c-4d29-9a5d-9308481092bc not found, creating... [ 1015.621943] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.622204] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.622332] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.622587] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.622778] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.623040] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.623224] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.623341] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.623598] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.623687] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.623826] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 9236d87e-195c-4d29-9a5d-9308481092bc is going to be created. [ 1015.651274] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.651573] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.651701] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.651981] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.652448] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.652699] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-9236d87e-195c-4d29-9a5d-9308481092bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.905118] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 in Status: SUCCESS [ 1015.905506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.270826] env[65413]: INFO networking_nsxv3.common.synchronization [req-712e5cf8-1306-4782-bc9f-a98458b3c0c2 req-fac1eca3-1b87-42a7-900a-617e3f02ec77 tempest-ServersTestBootFromVolume-237210338 tempest-ServersTestBootFromVolume-237210338-project-member] Enqueued Resource ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 with Priority: HIGHEST for action security_group_members [ 1016.271559] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 with Priority: HIGHEST for action security_group_members [ 1016.273130] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.273361] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.273501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.274572] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.275362] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.276651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.276651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.276651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.276651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.276651] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bdd0e27d-c1b3-4c8e-bf7a-7837e9769380',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.404579] env[65413]: INFO networking_nsxv3.common.synchronization [req-040a8dc2-301f-4b6f-85c4-0dbd28d62b55 req-2ca1e937-dff0-4ac4-92bd-5c5dc55ebc70 service nova] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_rules [ 1016.405701] env[65413]: INFO networking_nsxv3.common.synchronization [req-040a8dc2-301f-4b6f-85c4-0dbd28d62b55 req-2ca1e937-dff0-4ac4-92bd-5c5dc55ebc70 service nova] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 1016.405701] env[65413]: INFO networking_nsxv3.common.synchronization [req-040a8dc2-301f-4b6f-85c4-0dbd28d62b55 req-2ca1e937-dff0-4ac4-92bd-5c5dc55ebc70 service nova] Enqueued Resource ID: 9236d87e-195c-4d29-9a5d-9308481092bc with Priority: HIGHEST for action port [ 1016.405701] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_rules [ 1016.405701] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 1016.405701] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9236d87e-195c-4d29-9a5d-9308481092bc with Priority: HIGHEST for action port [ 1016.405995] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.405995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.406669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.406937] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.407076] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.408590] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.408759] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.410344] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-9236d87e-195c-4d29-9a5d-9308481092bc taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.410344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9236d87e-195c-4d29-9a5d-9308481092bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.410344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9236d87e-195c-4d29-9a5d-9308481092bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.410344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9236d87e-195c-4d29-9a5d-9308481092bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.410344] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9236d87e-195c-4d29-9a5d-9308481092bc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.422031] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 1016.422031] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 deletion is rescheduled due to dependency. [ 1016.422031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.431305] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 in Status: SUCCESS [ 1016.431621] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.431707] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.431882] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.432088] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.432221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.432288] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.432442] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.432520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.432637] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.432681] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.780743] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.780743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.780743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.780743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.780743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.780743] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.780743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.780743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.780743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.780743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.781174] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 is going to be updated. [ 1016.832803] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.832803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.832803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.832803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.832803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.843283] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 in Status: IN_PROGRESS for 2s [ 1016.909667] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.910697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.912948] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9236d87e-195c-4d29-9a5d-9308481092bc with status ACTIVE [ 1016.913237] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.914033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.914124] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.914362] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.914757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.915069] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.916063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.916063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.916063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.916241] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.916347] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.916438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.916478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.916629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.916706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.916785] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9236d87e-195c-4d29-9a5d-9308481092bc is going to be updated. [ 1016.934701] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.942981] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.943146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.943230] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.943464] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.943597] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.943750] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9236d87e-195c-4d29-9a5d-9308481092bc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.154378] env[65413]: INFO networking_nsxv3.common.synchronization [req-0664759a-b139-48b1-91ae-d91c725d7d6e req-0a8f0512-ace0-4c1a-94c1-641b9ed16c1a tempest-ServerDiskConfigTestJSON-938124936 tempest-ServerDiskConfigTestJSON-938124936-project-member] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1017.154972] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1017.155738] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.155738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.155738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.155738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.155976] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.156055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.156712] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.156712] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.156712] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.156883] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.190515] env[65413]: INFO networking_nsxv3.common.synchronization [req-6afb9859-2e4d-4eff-be1a-ae3b79f63e77 req-41870ec6-082f-4470-ab16-8e7053452cbe tempest-ImagesTestJSON-1309992501 tempest-ImagesTestJSON-1309992501-project-member] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 1017.191066] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGHEST for action security_group_members [ 1017.191552] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.191701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.191766] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.192031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.192302] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.192413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.192472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.192644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.192729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.192847] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.242831] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 1017.243151] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 deletion is rescheduled due to dependency. [ 1017.243312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.243488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.243747] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.244011] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.244193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.245075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.245323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.245420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.245531] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.437438] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4: rpc.has_security_group_logging(os_id): False [ 1017.477316] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.477510] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.477601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.480244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.480244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.480244] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.480244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.480244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.480244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.480244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.480244] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 is going to be created. [ 1017.590704] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.590704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.590704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.590956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.591061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.611343] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 in Status: IN_PROGRESS for 2s [ 1017.643397] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.643639] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.643639] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.643948] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.644540] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.644729] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.644846] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.645106] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.645252] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.645498] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.645611] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1017.645716] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1017.645820] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1017.645925] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1017.646041] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1017.646175] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1017.660429] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.660618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.660662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.660869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.660962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.661217] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.661311] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.665022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.665022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.665022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.665022] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 1017.692307] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1017.692509] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1017.692640] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1017.692834] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.693241] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-ad815bb8-7372-43b3-8184-6e19941a5f6f taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.693444] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-ad815bb8-7372-43b3-8184-6e19941a5f6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.693562] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-ad815bb8-7372-43b3-8184-6e19941a5f6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.693940] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-ad815bb8-7372-43b3-8184-6e19941a5f6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.694099] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad815bb8-7372-43b3-8184-6e19941a5f6f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.696928] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.697095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.697147] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.698162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.698162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.698162] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.698162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.698162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.698162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.698162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.698162] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be updated. [ 1017.719206] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.719531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.719531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.719615] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.719760] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.730642] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 1017.747993] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.750800] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.750963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.750963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.751273] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.752832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.771035] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: IN_PROGRESS for 2s [ 1018.203357] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.203698] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.203839] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.204216] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.204468] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.204688] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port ad815bb8-7372-43b3-8184-6e19941a5f6f not found, creating... [ 1018.205026] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.205218] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.205373] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.206813] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.206813] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.206813] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.206813] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.206813] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.207952] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.208680] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.208954] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: ad815bb8-7372-43b3-8184-6e19941a5f6f is going to be created. [ 1018.241025] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.241514] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.241643] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.242299] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.242679] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.243070] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-ad815bb8-7372-43b3-8184-6e19941a5f6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.255186] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.757835] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.758376] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.758376] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.758376] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.758376] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.758545] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 1018.809547] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.809547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.809547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.809547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.809990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.828909] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 1018.859919] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 in Status: SUCCESS [ 1018.860311] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 deletion is rescheduled due to dependency. [ 1018.860311] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.972182] env[65413]: INFO networking_nsxv3.common.synchronization [req-0664759a-b139-48b1-91ae-d91c725d7d6e req-0359dad1-a664-4c45-aa15-096785df987b service nova] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_rules [ 1018.972408] env[65413]: INFO networking_nsxv3.common.synchronization [req-0664759a-b139-48b1-91ae-d91c725d7d6e req-0359dad1-a664-4c45-aa15-096785df987b service nova] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1018.972538] env[65413]: INFO networking_nsxv3.common.synchronization [req-0664759a-b139-48b1-91ae-d91c725d7d6e req-0359dad1-a664-4c45-aa15-096785df987b service nova] Enqueued Resource ID: ad815bb8-7372-43b3-8184-6e19941a5f6f with Priority: HIGHEST for action port [ 1018.973871] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_rules [ 1018.973871] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1018.973871] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad815bb8-7372-43b3-8184-6e19941a5f6f with Priority: HIGHEST for action port [ 1018.974201] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.974399] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.974399] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.974603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.975321] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.978679] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.978799] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.979095] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad815bb8-7372-43b3-8184-6e19941a5f6f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.979187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad815bb8-7372-43b3-8184-6e19941a5f6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.979226] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad815bb8-7372-43b3-8184-6e19941a5f6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.979423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad815bb8-7372-43b3-8184-6e19941a5f6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.979507] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad815bb8-7372-43b3-8184-6e19941a5f6f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.482708] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ad815bb8-7372-43b3-8184-6e19941a5f6f with status ACTIVE [ 1019.482708] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.482994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.482994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.483166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.483270] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.483463] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.483586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.483647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.483811] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.483908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.484106] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.484205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.484261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.484403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.484495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.484578] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ad815bb8-7372-43b3-8184-6e19941a5f6f is going to be updated. [ 1019.485914] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.486052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.509284] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.509521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.509598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.509885] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.510085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.510276] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad815bb8-7372-43b3-8184-6e19941a5f6f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.630170] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 in Status: SUCCESS [ 1019.630411] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.745181] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 1019.745403] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 deletion is rescheduled due to dependency. [ 1019.745530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.745850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.746394] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.746790] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.746975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.747121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.747441] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.747617] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.747760] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.788467] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 650f4003-0da8-43a0-bfde-c7d15e589861 in Status: SUCCESS [ 1019.788783] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 deletion is rescheduled due to dependency. [ 1019.788943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.250769] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.598701] env[65413]: INFO networking_nsxv3.common.synchronization [req-0d40e478-b952-4978-815c-e48c21c24f27 req-2f99a4f8-e15d-4cba-b735-7021b5819c20 tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e with Priority: HIGHEST for action security_group_members [ 1020.599481] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e with Priority: HIGHEST for action security_group_members [ 1020.600268] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.600394] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.600475] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.600671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.600827] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.601078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.601078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.601197] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.601246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.601304] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('380e8f44-e830-45ac-b5a4-5ad6b4d43d1e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.685644] env[65413]: INFO networking_nsxv3.common.synchronization [req-08b084aa-f84e-4fae-a833-a35d6bdac155 req-6fc92ad7-75d8-4a3d-b24c-93226cc7594c tempest-ServerPasswordTestJSON-984186487 tempest-ServerPasswordTestJSON-984186487-project-member] Enqueued Resource ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 with Priority: HIGHEST for action security_group_members [ 1020.686227] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 with Priority: HIGHEST for action security_group_members [ 1020.686543] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f9d5ed73-228a-4ead-afe1-ed95ca323320 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.686667] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.686748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.686949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.687114] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.687210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.687270] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.687421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.687506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.687598] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f9d5ed73-228a-4ead-afe1-ed95ca323320',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.755182] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.840215] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 1020.840215] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.840606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.840606] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.840730] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.840854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.840916] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.841096] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.841175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.841258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.841408] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.104541] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.104541] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.104541] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.104541] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.104541] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.104910] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.105066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.105156] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.105354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.105464] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.105578] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e is going to be updated. [ 1021.136958] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.137145] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.137218] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.137434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.137609] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.150909] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e in Status: IN_PROGRESS for 2s [ 1021.189705] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.189930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.190099] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.190476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.190523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.190712] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.190813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.190877] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.191043] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.191121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.191240] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 is going to be updated. [ 1021.222219] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.222219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.222219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.222482] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.222538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.235488] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 in Status: IN_PROGRESS for 2s [ 1021.261711] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.261711] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.261711] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.261711] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.261711] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.261711] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 1021.294825] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.294975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.295043] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.296131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.296131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.313258] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 1021.344557] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.348346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.348346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.348346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.348346] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.348346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.348346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.348346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.348346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.348346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.348346] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.348346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.348346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.348346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.348346] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.348346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.348346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.348346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.348346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.349085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.349085] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.530847] env[65413]: INFO networking_nsxv3.common.synchronization [req-4f476c48-43ac-404c-908a-17ada4840f34 req-9eaa8e72-60ee-4146-8b21-165ffbe223d7 tempest-ServerActionsV293TestJSON-598190869 tempest-ServerActionsV293TestJSON-598190869-project-member] Enqueued Resource ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 with Priority: HIGHEST for action security_group_members [ 1021.531720] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 with Priority: HIGHEST for action security_group_members [ 1021.532021] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-065563e4-03b1-4f50-9075-8d4bf2c3fb60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.533997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.533997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.533997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.533997] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.534231] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.534231] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.534315] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.534356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.534479] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('065563e4-03b1-4f50-9075-8d4bf2c3fb60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.852281] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d96dd8be-7e0f-4527-b6b4-1fd21b89c256: rpc.has_security_group_logging(os_id): False [ 1021.875308] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.875779] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.875963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.876300] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.876499] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.876831] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.877077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.877237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.877519] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.878015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.878015] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.879322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.879322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.879322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.879322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.879322] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.879322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.879322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.879322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.879993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.879993] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 1021.906017] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-561 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.906233] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-561" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.906362] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-561" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.906686] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-561" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.907068] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.907164] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.907284] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.907503] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.907642] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.907846] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.907957] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1021.908073] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1021.908179] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1021.908285] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1021.908387] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1021.908518] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1021.928545] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1021.928800] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1021.928910] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1021.929050] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-561" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.929384] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-3eadb387-0c5f-4efa-8230-9187ca22af17 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.929705] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-3eadb387-0c5f-4efa-8230-9187ca22af17" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.929831] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-3eadb387-0c5f-4efa-8230-9187ca22af17" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.931092] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-3eadb387-0c5f-4efa-8230-9187ca22af17" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.931092] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eadb387-0c5f-4efa-8230-9187ca22af17',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.949488] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.949754] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.949754] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.949866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.950059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.963635] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 1022.037448] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.037605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.037669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.037909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.037999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.038235] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.038344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.038406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.038561] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.038640] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.038727] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 already deleted. [ 1022.038807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.432883] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.433098] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.433381] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.433716] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.433873] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.434051] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 3eadb387-0c5f-4efa-8230-9187ca22af17 not found, creating... [ 1022.434339] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.434643] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.434823] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.435104] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.435258] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.435598] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.435754] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.435829] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.436054] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.436190] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.436338] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 3eadb387-0c5f-4efa-8230-9187ca22af17 is going to be created. [ 1022.460438] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.460691] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.460863] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.461200] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.461474] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.461738] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-3eadb387-0c5f-4efa-8230-9187ca22af17" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.166200] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e in Status: SUCCESS [ 1023.166514] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e deletion is rescheduled due to dependency. [ 1023.166514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.251568] env[65413]: INFO networking_nsxv3.common.synchronization [req-4f476c48-43ac-404c-908a-17ada4840f34 req-f08417e3-9a00-4c08-a676-d3eeecea302d service nova] Enqueued Resource ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 with Priority: HIGHEST for action security_group_rules [ 1023.251746] env[65413]: INFO networking_nsxv3.common.synchronization [req-4f476c48-43ac-404c-908a-17ada4840f34 req-f08417e3-9a00-4c08-a676-d3eeecea302d service nova] Enqueued Resource ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 with Priority: HIGHEST for action security_group_members [ 1023.251882] env[65413]: INFO networking_nsxv3.common.synchronization [req-4f476c48-43ac-404c-908a-17ada4840f34 req-f08417e3-9a00-4c08-a676-d3eeecea302d service nova] Enqueued Resource ID: 3eadb387-0c5f-4efa-8230-9187ca22af17 with Priority: HIGHEST for action port [ 1023.252877] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 in Status: IN_PROGRESS for 4s [ 1023.253734] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 with Priority: HIGHEST for action security_group_rules [ 1023.254053] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 with Priority: HIGHEST for action security_group_members [ 1023.254136] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3eadb387-0c5f-4efa-8230-9187ca22af17 with Priority: HIGHEST for action port [ 1023.254523] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.254688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.254752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.254968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.255064] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('065563e4-03b1-4f50-9075-8d4bf2c3fb60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.256575] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-065563e4-03b1-4f50-9075-8d4bf2c3fb60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.256575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.256731] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.256954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.257116] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.257228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.257287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.257475] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.257549] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.257618] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('065563e4-03b1-4f50-9075-8d4bf2c3fb60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.259064] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-3eadb387-0c5f-4efa-8230-9187ca22af17 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.259064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3eadb387-0c5f-4efa-8230-9187ca22af17" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.259329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3eadb387-0c5f-4efa-8230-9187ca22af17" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.259378] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3eadb387-0c5f-4efa-8230-9187ca22af17" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.259420] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3eadb387-0c5f-4efa-8230-9187ca22af17',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.335470] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 1023.335733] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.335936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.336211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.336428] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.337214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.337214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.337214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.337214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.337214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.337743] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.757551] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-065563e4-03b1-4f50-9075-8d4bf2c3fb60 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.757705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.759068] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('065563e4-03b1-4f50-9075-8d4bf2c3fb60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.761960] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3eadb387-0c5f-4efa-8230-9187ca22af17 with status ACTIVE [ 1023.762125] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.762395] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.762395] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.762596] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.762757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.762851] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.762948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.763026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.763261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.763365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.764645] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.764645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.764645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.764645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.764645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.764645] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3eadb387-0c5f-4efa-8230-9187ca22af17 is going to be updated. [ 1023.786310] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.786462] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.786520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.786725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.786861] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.787016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3eadb387-0c5f-4efa-8230-9187ca22af17" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.840026] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.840308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.840387] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.840615] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.840791] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.841328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.841328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.841328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.841328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.841328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.841601] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.841601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.841601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.841774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.841899] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.841993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.842064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.842284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.842433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.842433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.842531] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.979602] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 1023.979833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.262341] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('065563e4-03b1-4f50-9075-8d4bf2c3fb60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.345956] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 579e1066-bea4-4954-a499-fb0ae75b5375: rpc.has_security_group_logging(os_id): False [ 1024.367097] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.367329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.367329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.367542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.367656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.367957] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.368075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.368190] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.368426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.368477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.368707] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.368822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.368939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.369071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.369184] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.369433] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.369828] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.369828] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.369828] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.369954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.369954] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 1024.456821] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.457037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.457088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.457354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.457577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.492256] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 1024.765653] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.765831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.765881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.766130] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.766220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.766320] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 is going to be created. [ 1024.798459] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.798757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.798757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.799113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.799380] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.812997] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 in Status: UNINITIALIZED for 2s [ 1025.268331] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 in Status: SUCCESS [ 1025.268579] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 deletion is rescheduled due to dependency. [ 1025.268714] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.508442] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 1026.509353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.835221] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 in Status: SUCCESS [ 1026.835221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.835221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.835221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.835221] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.835221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.835221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.835221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.835221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.835221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.835221] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('065563e4-03b1-4f50-9075-8d4bf2c3fb60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.338320] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('065563e4-03b1-4f50-9075-8d4bf2c3fb60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.841494] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 065563e4-03b1-4f50-9075-8d4bf2c3fb60: rpc.has_security_group_logging(os_id): False [ 1027.866240] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.866240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.866240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.866240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.866240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.866240] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.866240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.866240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.866240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.866240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.866240] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 is going to be created. [ 1027.952937] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.953150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.953150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.953489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.953677] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.970904] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 in Status: IN_PROGRESS for 2s [ 1028.255526] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1028.255823] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1028.462903] env[65413]: INFO networking_nsxv3.common.synchronization [None req-e699fc3b-df22-47d4-8ce7-844eaf6bddae None None] Enqueued Resource ID: f8ff8b3d-fc30-4638-b667-7d08876beb3c with Priority: HIGHEST for action port [ 1028.463841] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8ff8b3d-fc30-4638-b667-7d08876beb3c with Priority: HIGHEST for action port [ 1028.463993] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8ff8b3d-fc30-4638-b667-7d08876beb3c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.464514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8ff8b3d-fc30-4638-b667-7d08876beb3c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.464600] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8ff8b3d-fc30-4638-b667-7d08876beb3c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.464886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8ff8b3d-fc30-4638-b667-7d08876beb3c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.465011] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8ff8b3d-fc30-4638-b667-7d08876beb3c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.860111] env[65413]: INFO networking_nsxv3.common.synchronization [req-bf16e63c-e43f-4190-91fc-7de6d83e2bf7 req-b460fca7-cde5-4a6c-a841-55b1de245638 tempest-ServerActionsTestJSON-1087044681 tempest-ServerActionsTestJSON-1087044681-project-member] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 1028.860111] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 1028.860620] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.860620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.860620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.860788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.861091] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.861091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.861091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.861329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.861329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.861456] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.969198] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8ff8b3d-fc30-4638-b667-7d08876beb3c [ 1028.969198] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.969198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.969198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.969198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.969198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.969198] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8ff8b3d-fc30-4638-b667-7d08876beb3c already deleted. [ 1028.969198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8ff8b3d-fc30-4638-b667-7d08876beb3c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.287337] env[65413]: INFO networking_nsxv3.common.synchronization [req-502c6110-f15d-4cfa-b290-7267dcbdf0dd req-a5750deb-71ab-4188-bdd7-a1627a487387 tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 with Priority: HIGHEST for action security_group_members [ 1029.287814] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 with Priority: HIGHEST for action security_group_members [ 1029.289422] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.289422] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.289422] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.289912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.291967] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.291967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.291967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.291967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.291967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.291967] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e66f37bc-ef47-4d76-937b-4d1c38a4ffe7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.365122] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.369068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.370358] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.370751] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.370924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.371323] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.371528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.371642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.371905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.372059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.372227] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef is going to be updated. [ 1029.406086] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.406086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.406086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.406086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.406086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.416684] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: IN_PROGRESS for 2s [ 1029.613475] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-56 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.613475] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.613475] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.613475] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.613756] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.616867] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.616867] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.616867] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.616867] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.616867] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.616867] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1029.616867] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1029.616867] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1029.616867] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1029.616867] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1029.616867] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1029.643829] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1029.644293] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1029.644293] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1029.644551] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.644946] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-dab09017-f566-4ddd-85b4-e6adb3ec7fa4 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.645242] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-dab09017-f566-4ddd-85b4-e6adb3ec7fa4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.645405] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-dab09017-f566-4ddd-85b4-e6adb3ec7fa4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.645770] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-dab09017-f566-4ddd-85b4-e6adb3ec7fa4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.645949] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dab09017-f566-4ddd-85b4-e6adb3ec7fa4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.795168] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.795168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.795168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.795457] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.795457] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.796018] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.796018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.796018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.796018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.796218] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.796218] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 is going to be updated. [ 1029.824239] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.824410] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.824464] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.824733] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.824879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.835603] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 in Status: IN_PROGRESS for 2s [ 1029.988759] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 in Status: SUCCESS [ 1029.988759] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.057451] env[65413]: INFO networking_nsxv3.common.synchronization [None req-a56c033c-793d-401f-94bf-8231610ea141 tempest-ServersV294TestFqdnHostnames-208752401 tempest-ServersV294TestFqdnHostnames-208752401-project-member] Enqueued Resource ID: 2eaf869e-a041-4425-9c95-622578933869 with Priority: HIGHEST for action security_group_rules [ 1030.057451] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eaf869e-a041-4425-9c95-622578933869 with Priority: HIGHEST for action security_group_rules [ 1030.057451] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2eaf869e-a041-4425-9c95-622578933869 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.057817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.058021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.058370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.058577] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2eaf869e-a041-4425-9c95-622578933869',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.149448] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.150031] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.150031] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.150140] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.150225] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.150383] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port dab09017-f566-4ddd-85b4-e6adb3ec7fa4 not found, creating... [ 1030.150650] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.150808] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.150922] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.151165] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.151300] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.151591] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.151750] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.151864] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.152098] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.152265] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.152410] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: dab09017-f566-4ddd-85b4-e6adb3ec7fa4 is going to be created. [ 1030.175270] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.175270] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.175439] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.176233] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.176233] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.176233] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-dab09017-f566-4ddd-85b4-e6adb3ec7fa4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.248932] env[65413]: INFO networking_nsxv3.common.synchronization [None req-f218ee57-41bd-4fab-9c87-e93a22434f74 tempest-ServersV294TestFqdnHostnames-208752401 tempest-ServersV294TestFqdnHostnames-208752401-project-member] Enqueued Resource ID: 2eaf869e-a041-4425-9c95-622578933869 with Priority: HIGHEST for action security_group_rules [ 1030.248932] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eaf869e-a041-4425-9c95-622578933869 with Priority: HIGHEST for action security_group_rules [ 1030.248932] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2eaf869e-a041-4425-9c95-622578933869 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.248932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.581863] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.582057] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.582100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.582325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.582420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.582516] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2eaf869e-a041-4425-9c95-622578933869 already deleted. [ 1030.582598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.582746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.582896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.582978] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2eaf869e-a041-4425-9c95-622578933869',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.798952] env[65413]: INFO networking_nsxv3.common.synchronization [None req-dcf09e59-1798-4aca-843d-4ea8e6ed05bb None None] Enqueued Resource ID: 42b6f7c8-88d0-4fc1-b514-daf533809d33 with Priority: HIGHEST for action port [ 1030.798952] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42b6f7c8-88d0-4fc1-b514-daf533809d33 with Priority: HIGHEST for action port [ 1030.798952] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-42b6f7c8-88d0-4fc1-b514-daf533809d33 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.798952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42b6f7c8-88d0-4fc1-b514-daf533809d33" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.798952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42b6f7c8-88d0-4fc1-b514-daf533809d33" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.798952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42b6f7c8-88d0-4fc1-b514-daf533809d33" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.798952] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42b6f7c8-88d0-4fc1-b514-daf533809d33',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.873202] env[65413]: INFO networking_nsxv3.common.synchronization [req-bf16e63c-e43f-4190-91fc-7de6d83e2bf7 req-a9f5eb0e-3672-4bc9-8604-eedd5dc32686 service nova] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_rules [ 1030.873372] env[65413]: INFO networking_nsxv3.common.synchronization [req-bf16e63c-e43f-4190-91fc-7de6d83e2bf7 req-a9f5eb0e-3672-4bc9-8604-eedd5dc32686 service nova] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 1030.873728] env[65413]: INFO networking_nsxv3.common.synchronization [req-bf16e63c-e43f-4190-91fc-7de6d83e2bf7 req-a9f5eb0e-3672-4bc9-8604-eedd5dc32686 service nova] Enqueued Resource ID: dab09017-f566-4ddd-85b4-e6adb3ec7fa4 with Priority: HIGHEST for action port [ 1030.874112] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_rules [ 1030.875476] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 1030.875476] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dab09017-f566-4ddd-85b4-e6adb3ec7fa4 with Priority: HIGHEST for action port [ 1030.875476] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.875476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.875476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.875476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.875476] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.876125] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.876528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.876528] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-dab09017-f566-4ddd-85b4-e6adb3ec7fa4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.876528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dab09017-f566-4ddd-85b4-e6adb3ec7fa4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.876762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dab09017-f566-4ddd-85b4-e6adb3ec7fa4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.876762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dab09017-f566-4ddd-85b4-e6adb3ec7fa4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.876916] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dab09017-f566-4ddd-85b4-e6adb3ec7fa4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.105195] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.105607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.105607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.105803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.105926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.106067] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2eaf869e-a041-4425-9c95-622578933869 already deleted. [ 1031.106179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.291369] env[65413]: INFO networking_nsxv3.common.synchronization [req-2e2072cc-527d-4afe-8840-837c0086ada4 req-cdbe0cf4-383d-45b6-926e-a8c13b13cfeb tempest-ServerActionsTestOtherB-69504015 tempest-ServerActionsTestOtherB-69504015-project-member] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1031.291810] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1031.292139] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.292295] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.292476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.292956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.292956] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.292956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.292956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.293251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.293598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.293598] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.300659] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42b6f7c8-88d0-4fc1-b514-daf533809d33 [ 1031.300849] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.300980] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.301036] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.301220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.301427] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.301427] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42b6f7c8-88d0-4fc1-b514-daf533809d33 already deleted. [ 1031.301542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42b6f7c8-88d0-4fc1-b514-daf533809d33" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.379460] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.379641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.379987] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dab09017-f566-4ddd-85b4-e6adb3ec7fa4 with status ACTIVE [ 1031.380248] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.380373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.380488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.380694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.380854] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.381106] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.381272] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.381357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.381545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.381626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.381801] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.381910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.381955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.382178] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.382288] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.382372] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dab09017-f566-4ddd-85b4-e6adb3ec7fa4 is going to be updated. [ 1031.408596] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.408825] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.408825] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.409018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.409158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.409305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dab09017-f566-4ddd-85b4-e6adb3ec7fa4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.427410] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: SUCCESS [ 1031.427532] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef deletion is rescheduled due to dependency. [ 1031.427612] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.427763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.428022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.428338] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.428468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.428631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.428918] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.430065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.430065] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.634166] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.634514] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.634598] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.634924] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.635256] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.635474] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.635627] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.635886] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.636101] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.636395] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.636506] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1031.636630] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1031.636680] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1031.636824] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.636948] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1031.637124] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1031.656783] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1031.656985] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1031.657183] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1031.657490] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.657842] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-ac69e6cf-9641-4f44-8f4a-7eed4f33df76 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.658090] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-ac69e6cf-9641-4f44-8f4a-7eed4f33df76" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.658270] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-ac69e6cf-9641-4f44-8f4a-7eed4f33df76" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.658671] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-ac69e6cf-9641-4f44-8f4a-7eed4f33df76" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.658847] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac69e6cf-9641-4f44-8f4a-7eed4f33df76',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.797557] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.797761] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.797810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.798041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.798132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.798336] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.798451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.798543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.798736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.798815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.798903] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded is going to be updated. [ 1031.848448] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 in Status: SUCCESS [ 1031.848680] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 deletion is rescheduled due to dependency. [ 1031.848860] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.855677] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.855918] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.855918] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.856155] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.856298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.865931] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: IN_PROGRESS for 2s [ 1031.931470] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.162090] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.162575] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.162575] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.163305] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.163464] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.163627] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port ac69e6cf-9641-4f44-8f4a-7eed4f33df76 not found, creating... [ 1032.163937] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.164111] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.164226] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.164465] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.164676] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.165633] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.165633] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.165633] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.165633] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.165633] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.165996] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: ac69e6cf-9641-4f44-8f4a-7eed4f33df76 is going to be created. [ 1032.202922] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.202922] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.202922] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.202922] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.202922] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.202922] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-ac69e6cf-9641-4f44-8f4a-7eed4f33df76" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.434977] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.929260] env[65413]: INFO networking_nsxv3.common.synchronization [req-2e2072cc-527d-4afe-8840-837c0086ada4 req-d75143f5-27fd-4b3d-84c8-55c9473dd889 service nova] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_rules [ 1032.929260] env[65413]: INFO networking_nsxv3.common.synchronization [req-2e2072cc-527d-4afe-8840-837c0086ada4 req-d75143f5-27fd-4b3d-84c8-55c9473dd889 service nova] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1032.929260] env[65413]: INFO networking_nsxv3.common.synchronization [req-2e2072cc-527d-4afe-8840-837c0086ada4 req-d75143f5-27fd-4b3d-84c8-55c9473dd889 service nova] Enqueued Resource ID: ac69e6cf-9641-4f44-8f4a-7eed4f33df76 with Priority: HIGHEST for action port [ 1032.929260] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_rules [ 1032.929632] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1032.929632] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac69e6cf-9641-4f44-8f4a-7eed4f33df76 with Priority: HIGHEST for action port [ 1032.930424] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.930786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.930786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.931060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.931150] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.934165] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.934165] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.934419] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-ac69e6cf-9641-4f44-8f4a-7eed4f33df76 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.934563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ac69e6cf-9641-4f44-8f4a-7eed4f33df76" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.934631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ac69e6cf-9641-4f44-8f4a-7eed4f33df76" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.934838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ac69e6cf-9641-4f44-8f4a-7eed4f33df76" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.934922] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ac69e6cf-9641-4f44-8f4a-7eed4f33df76',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.939015] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.939147] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.939225] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.939430] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.939528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.939634] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef is going to be updated. [ 1032.972196] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.972196] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.972196] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.972421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.972421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.983349] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: IN_PROGRESS for 2s [ 1033.439207] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.439207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.439207] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ac69e6cf-9641-4f44-8f4a-7eed4f33df76 with status ACTIVE [ 1033.439649] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.439649] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.439649] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.439783] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.439783] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.439995] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.440136] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.440136] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.440240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.440302] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.440478] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.440569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.440635] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.440778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.440827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.440901] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ac69e6cf-9641-4f44-8f4a-7eed4f33df76 is going to be updated. [ 1033.464832] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.464981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.465062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.465600] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.465745] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.465926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ac69e6cf-9641-4f44-8f4a-7eed4f33df76" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.877196] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: SUCCESS [ 1033.877373] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded deletion is rescheduled due to dependency. [ 1033.877683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.877683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.877889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.878021] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.878142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.878208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.878363] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.878445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.878579] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.383811] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.888343] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.995819] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: SUCCESS [ 1034.996050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.996220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.996441] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.996638] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.996801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.996895] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.997082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.997166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.997254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.997399] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.394625] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.395433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.395433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.395433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.395433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.395433] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded is going to be updated. [ 1035.430507] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.430658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.430705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.430916] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.431144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.452358] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: IN_PROGRESS for 2s [ 1035.499405] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.845246] env[65413]: INFO networking_nsxv3.common.synchronization [None req-ab6d1538-38d7-4c97-a0a2-5bbddd8da77f tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_rules [ 1035.846211] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_rules [ 1035.846604] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.846758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.846892] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.847287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.847632] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.002278] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d31c425c-609d-448d-bad8-0a938d0bf8ef: rpc.has_security_group_logging(os_id): False [ 1036.011627] env[65413]: INFO networking_nsxv3.common.synchronization [None req-e98a5a15-5358-4936-a893-cd940d4664ea tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_rules [ 1036.012417] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_rules [ 1036.012674] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.012844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.025833] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.025833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.025833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.025833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.025833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.026518] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.026688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.026781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.026970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.027106] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.027206] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef is going to be updated. [ 1036.100896] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.101095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.101147] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.101402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.101466] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.114883] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: IN_PROGRESS for 2s [ 1036.385982] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.385982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.385982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.385982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.385982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.385982] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a already deleted. [ 1036.385982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.385982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.385982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.385982] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.917098] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.917098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.917098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.917098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.917098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.917098] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a already deleted. [ 1036.917098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.113211] env[65413]: INFO networking_nsxv3.common.synchronization [None req-a57b2786-0b61-43e7-a145-7a10377f0347 None None] Enqueued Resource ID: 3d50435e-f417-4e3f-a0f8-35b5841734d0 with Priority: HIGHEST for action port [ 1037.113211] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d50435e-f417-4e3f-a0f8-35b5841734d0 with Priority: HIGHEST for action port [ 1037.113211] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d50435e-f417-4e3f-a0f8-35b5841734d0 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.113211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d50435e-f417-4e3f-a0f8-35b5841734d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.113211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d50435e-f417-4e3f-a0f8-35b5841734d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.113211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d50435e-f417-4e3f-a0f8-35b5841734d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.113211] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d50435e-f417-4e3f-a0f8-35b5841734d0',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.464243] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: SUCCESS [ 1037.464546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.464774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.465069] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.465318] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.465473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.465561] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.465763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.465867] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.465981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.466353] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.617823] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d50435e-f417-4e3f-a0f8-35b5841734d0 [ 1037.617823] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.617823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.617823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.621231] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.621491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.621715] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d50435e-f417-4e3f-a0f8-35b5841734d0 already deleted. [ 1037.621988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d50435e-f417-4e3f-a0f8-35b5841734d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.970216] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.133453] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: SUCCESS [ 1038.133453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.473083] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4aeeb11-908b-4980-9ebd-3c96e2724ded: rpc.has_security_group_logging(os_id): False [ 1038.491226] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.491226] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.491440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.491501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.491586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.491846] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.491948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.492017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.492225] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.492340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.492340] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded is going to be updated. [ 1038.551824] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.551824] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.551824] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.551824] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.551824] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.565785] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: IN_PROGRESS for 2s [ 1039.780392] env[65413]: INFO networking_nsxv3.common.synchronization [None req-6697c90c-1de3-484d-be95-81bc3969f622 None None] Enqueued Resource ID: eed33918-326c-4ca7-8a35-017f4c16d00c with Priority: HIGHEST for action port [ 1039.781245] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eed33918-326c-4ca7-8a35-017f4c16d00c with Priority: HIGHEST for action port [ 1039.781323] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-eed33918-326c-4ca7-8a35-017f4c16d00c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.781392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-eed33918-326c-4ca7-8a35-017f4c16d00c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.782903] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-eed33918-326c-4ca7-8a35-017f4c16d00c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.782903] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-eed33918-326c-4ca7-8a35-017f4c16d00c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.782903] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('eed33918-326c-4ca7-8a35-017f4c16d00c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.284497] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port eed33918-326c-4ca7-8a35-017f4c16d00c [ 1040.284924] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.285087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.285087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.285563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.285563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.285563] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:eed33918-326c-4ca7-8a35-017f4c16d00c already deleted. [ 1040.287949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-eed33918-326c-4ca7-8a35-017f4c16d00c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.440643] env[65413]: INFO networking_nsxv3.common.synchronization [None req-e7c1c974-9b93-4198-94d3-cf0befa4bca9 tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 with Priority: HIGHEST for action security_group_rules [ 1040.440643] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 with Priority: HIGHEST for action security_group_rules [ 1040.441181] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.442147] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.442147] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.442548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.442548] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.561162] env[65413]: INFO networking_nsxv3.common.synchronization [None req-dfe9a55c-90b2-4e9d-8c4e-24326f424fe2 tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 with Priority: HIGHEST for action security_group_rules [ 1040.562066] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 with Priority: HIGHEST for action security_group_rules [ 1040.562686] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.563060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.581769] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: SUCCESS [ 1040.582029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.972161] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.972161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.972161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.972739] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.972943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.973071] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 already deleted. [ 1040.973173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.973356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.973565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.973645] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.495716] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.495862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.495927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.496182] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.496268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.496361] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 already deleted. [ 1041.496442] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.050253] env[65413]: INFO networking_nsxv3.common.synchronization [req-8b9638bc-ae57-4128-bc74-0036a9d8f25f req-c64a5a8b-c136-49c3-b3ac-dc7135474673 tempest-ServersNegativeTestJSON-1140018984 tempest-ServersNegativeTestJSON-1140018984-project-member] Enqueued Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_members [ 1044.050608] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e with Priority: HIGHEST for action security_group_members [ 1044.050928] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.052166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.052166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.052166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.052166] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.052166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.052166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.052166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.052166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.052166] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d35feb8-5ef7-43ac-855e-ecb9d850ee7e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.422758] env[65413]: INFO networking_nsxv3.common.synchronization [req-5f5444fa-7976-4d2e-aa2e-7fea6f33daa9 req-421e20c6-41d2-4900-a143-bf2ea3397952 tempest-ServersV294TestFqdnHostnames-208752401 tempest-ServersV294TestFqdnHostnames-208752401-project-member] Enqueued Resource ID: 2eaf869e-a041-4425-9c95-622578933869 with Priority: HIGHEST for action security_group_members [ 1044.423948] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eaf869e-a041-4425-9c95-622578933869 with Priority: HIGHEST for action security_group_members [ 1044.424291] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-2eaf869e-a041-4425-9c95-622578933869 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.424431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.424514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.424855] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.425021] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.425123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.425183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.425363] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.425449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.425540] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2eaf869e-a041-4425-9c95-622578933869',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.554762] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.555732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.555884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.556186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.556340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.556591] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.556730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.556817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.557497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.557497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.557497] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e is going to be updated. [ 1044.591289] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.591289] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.591289] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.591289] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.591289] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.601487] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: IN_PROGRESS for 2s [ 1044.780037] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-433 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.780346] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-433" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.780512] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-433" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.780860] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-433" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.781188] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.781398] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.781567] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.781832] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.782039] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.782305] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1044.782467] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1044.782657] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1044.782805] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1044.782951] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1044.783130] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1044.783357] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1044.811190] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1044.811377] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1044.811517] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1044.811726] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-433" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.812267] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-c6b0dc50-903e-4458-8efa-75ec3dff016c taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.812498] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-c6b0dc50-903e-4458-8efa-75ec3dff016c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.812618] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-c6b0dc50-903e-4458-8efa-75ec3dff016c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.813015] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-c6b0dc50-903e-4458-8efa-75ec3dff016c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.813305] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6b0dc50-903e-4458-8efa-75ec3dff016c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.930054] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.930396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.930543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.930775] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.930861] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.931103] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.931248] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.931320] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.931480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.931640] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.931777] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2eaf869e-a041-4425-9c95-622578933869 already deleted. [ 1044.931881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.317206] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.317206] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.317206] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.317702] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.317702] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.317702] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port c6b0dc50-903e-4458-8efa-75ec3dff016c not found, creating... [ 1045.317896] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.318065] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.318182] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.318396] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.318533] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.318810] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.318961] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.319224] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.319487] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.319670] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.319870] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: c6b0dc50-903e-4458-8efa-75ec3dff016c is going to be created. [ 1045.343181] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.343442] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.343583] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.343855] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.344094] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.344369] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-c6b0dc50-903e-4458-8efa-75ec3dff016c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.022428] env[65413]: INFO networking_nsxv3.common.synchronization [req-5f5444fa-7976-4d2e-aa2e-7fea6f33daa9 req-fef3a69e-0412-4c4e-ba1a-29997dafd4c8 service nova] Enqueued Resource ID: 2eaf869e-a041-4425-9c95-622578933869 with Priority: HIGHEST for action security_group_rules [ 1046.023551] env[65413]: INFO networking_nsxv3.common.synchronization [req-5f5444fa-7976-4d2e-aa2e-7fea6f33daa9 req-fef3a69e-0412-4c4e-ba1a-29997dafd4c8 service nova] Enqueued Resource ID: 2eaf869e-a041-4425-9c95-622578933869 with Priority: HIGHEST for action security_group_members [ 1046.023767] env[65413]: INFO networking_nsxv3.common.synchronization [req-5f5444fa-7976-4d2e-aa2e-7fea6f33daa9 req-fef3a69e-0412-4c4e-ba1a-29997dafd4c8 service nova] Enqueued Resource ID: c6b0dc50-903e-4458-8efa-75ec3dff016c with Priority: HIGHEST for action port [ 1046.024329] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eaf869e-a041-4425-9c95-622578933869 with Priority: HIGHEST for action security_group_rules [ 1046.024471] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eaf869e-a041-4425-9c95-622578933869 with Priority: HIGHEST for action security_group_members [ 1046.024576] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6b0dc50-903e-4458-8efa-75ec3dff016c with Priority: HIGHEST for action port [ 1046.024910] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2eaf869e-a041-4425-9c95-622578933869 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.025049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.025120] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.025331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.025416] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2eaf869e-a041-4425-9c95-622578933869',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.026266] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-2eaf869e-a041-4425-9c95-622578933869 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.026374] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.026443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.026618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.027060] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.027171] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.027236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.028409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.028409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.028409] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2eaf869e-a041-4425-9c95-622578933869',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.028409] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6b0dc50-903e-4458-8efa-75ec3dff016c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.028409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6b0dc50-903e-4458-8efa-75ec3dff016c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.028928] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6b0dc50-903e-4458-8efa-75ec3dff016c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.028928] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6b0dc50-903e-4458-8efa-75ec3dff016c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.028928] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6b0dc50-903e-4458-8efa-75ec3dff016c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.529923] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2eaf869e-a041-4425-9c95-622578933869',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.531079] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-2eaf869e-a041-4425-9c95-622578933869 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.531191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.533337] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c6b0dc50-903e-4458-8efa-75ec3dff016c with status ACTIVE [ 1046.533617] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.533729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.533797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.534015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.534117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.534291] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.534394] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.534454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.534624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.534713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.534964] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.535082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.535147] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.535318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.535401] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.535524] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c6b0dc50-903e-4458-8efa-75ec3dff016c is going to be updated. [ 1046.560639] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.560824] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.560871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.561067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.561199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.561351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6b0dc50-903e-4458-8efa-75ec3dff016c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.611095] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e in Status: SUCCESS [ 1046.611289] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d35feb8-5ef7-43ac-855e-ecb9d850ee7e deletion is rescheduled due to dependency. [ 1046.611335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d35feb8-5ef7-43ac-855e-ecb9d850ee7e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.032772] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2eaf869e-a041-4425-9c95-622578933869',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.536023] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.536653] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.536653] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.536810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.536810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.537179] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2eaf869e-a041-4425-9c95-622578933869 is going to be created. [ 1047.563425] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.563796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.563898] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.564573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.564573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.575864] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2eaf869e-a041-4425-9c95-622578933869 in Status: UNINITIALIZED for 2s [ 1047.638431] env[65413]: INFO networking_nsxv3.common.synchronization [req-140d4c30-3ef4-4ecf-9d7b-643ce7c040f7 req-04f0b925-1f60-4189-a8ce-ca39bfe61bce tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_members [ 1047.639672] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_members [ 1047.639672] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.639672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.639672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.640032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.640032] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.640220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.640318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.640485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.640553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.640661] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.981352] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.981718] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.981875] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.982278] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.982633] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.982815] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.982937] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.983225] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.983411] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.983724] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.983837] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1047.983947] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1047.984067] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1047.984235] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1047.984303] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1047.984407] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1048.006836] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1048.007042] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1048.007175] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1048.007680] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.007680] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-52f05bf7-02a4-4936-8bc5-bc1d55d4c06e taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.007931] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-52f05bf7-02a4-4936-8bc5-bc1d55d4c06e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.007931] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-52f05bf7-02a4-4936-8bc5-bc1d55d4c06e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.008307] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-52f05bf7-02a4-4936-8bc5-bc1d55d4c06e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.008471] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52f05bf7-02a4-4936-8bc5-bc1d55d4c06e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.143616] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.143898] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.143972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.144212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.144364] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.144687] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.144820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.144870] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.145023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.145103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.145191] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a already deleted. [ 1048.145335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.510867] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.511118] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.511246] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.511571] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.511718] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.511875] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 52f05bf7-02a4-4936-8bc5-bc1d55d4c06e not found, creating... [ 1048.512152] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.512305] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.512479] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.512744] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.512889] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.513185] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.513339] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.513472] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.513691] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.513823] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.513959] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 52f05bf7-02a4-4936-8bc5-bc1d55d4c06e is going to be created. [ 1048.537618] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.538116] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.538116] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.538276] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.538472] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.538689] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-52f05bf7-02a4-4936-8bc5-bc1d55d4c06e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.237749] env[65413]: INFO networking_nsxv3.common.synchronization [req-140d4c30-3ef4-4ecf-9d7b-643ce7c040f7 req-291a9918-7dd6-4541-a062-bcaa925b98ce service nova] Enqueued Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_rules [ 1049.237929] env[65413]: INFO networking_nsxv3.common.synchronization [req-140d4c30-3ef4-4ecf-9d7b-643ce7c040f7 req-291a9918-7dd6-4541-a062-bcaa925b98ce service nova] Enqueued Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_members [ 1049.238108] env[65413]: INFO networking_nsxv3.common.synchronization [req-140d4c30-3ef4-4ecf-9d7b-643ce7c040f7 req-291a9918-7dd6-4541-a062-bcaa925b98ce service nova] Enqueued Resource ID: 52f05bf7-02a4-4936-8bc5-bc1d55d4c06e with Priority: HIGHEST for action port [ 1049.238604] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_rules [ 1049.238743] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_members [ 1049.238825] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f05bf7-02a4-4936-8bc5-bc1d55d4c06e with Priority: HIGHEST for action port [ 1049.239117] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.239232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.239317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.239498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.239790] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.240791] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.240894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.240955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.241142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.241286] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.241380] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.241472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.241578] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.241659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.241748] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.245030] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-52f05bf7-02a4-4936-8bc5-bc1d55d4c06e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.245030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52f05bf7-02a4-4936-8bc5-bc1d55d4c06e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.245030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52f05bf7-02a4-4936-8bc5-bc1d55d4c06e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.245030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52f05bf7-02a4-4936-8bc5-bc1d55d4c06e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.245030] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52f05bf7-02a4-4936-8bc5-bc1d55d4c06e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.586488] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2eaf869e-a041-4425-9c95-622578933869 in Status: SUCCESS [ 1049.586810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.586864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.587103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.587291] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.587407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.587465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.587694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.587694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.587776] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.587858] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2eaf869e-a041-4425-9c95-622578933869',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.745870] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.746917] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.747057] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.747413] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52f05bf7-02a4-4936-8bc5-bc1d55d4c06e with status ACTIVE [ 1049.748027] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.748027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.748027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.748027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.748027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.748327] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.748327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.748327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.748506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.748637] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.748738] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.748833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.748894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.749047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.749121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.749205] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52f05bf7-02a4-4936-8bc5-bc1d55d4c06e is going to be updated. [ 1049.772981] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.773185] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.773185] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.773365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.773495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.773644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52f05bf7-02a4-4936-8bc5-bc1d55d4c06e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.090667] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2eaf869e-a041-4425-9c95-622578933869',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.248653] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.593168] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2eaf869e-a041-4425-9c95-622578933869: rpc.has_security_group_logging(os_id): False [ 1050.612049] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.612236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.612364] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.612632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.612735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.613009] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.613129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.613191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.613387] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.613470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.613599] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2eaf869e-a041-4425-9c95-622578933869 is going to be created. [ 1050.676988] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.677223] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.677324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.677534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.677709] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.693856] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2eaf869e-a041-4425-9c95-622578933869 in Status: IN_PROGRESS for 2s [ 1050.751618] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.751864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.751864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.752137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.752228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.752329] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a is going to be created. [ 1050.798978] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.799264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.799264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.799551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.799711] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.813457] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a in Status: UNINITIALIZED for 2s [ 1050.832823] env[65413]: INFO networking_nsxv3.common.synchronization [req-5b831956-c86e-4df5-badb-23a70f417295 req-c3b8b481-f2d1-45d2-aa8d-8898d985c3fc tempest-ServersTestJSON-1291473095 tempest-ServersTestJSON-1291473095-project-member] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1050.833662] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1050.834019] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.834152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.834216] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.834491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.834667] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.834779] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.834841] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.835007] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.835123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.835218] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.173119] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.174044] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.174044] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.174044] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.174242] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.174773] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.174773] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.175021] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.176329] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.176329] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1051.176329] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1051.176329] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1051.176329] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1051.176329] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1051.176329] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1051.176955] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1051.208775] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1051.208984] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1051.209158] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1051.209446] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.209842] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-5e910ffd-ed63-483f-9e19-a406471bcc7a taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.210080] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-5e910ffd-ed63-483f-9e19-a406471bcc7a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.210214] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-5e910ffd-ed63-483f-9e19-a406471bcc7a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.210587] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-5e910ffd-ed63-483f-9e19-a406471bcc7a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.210728] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e910ffd-ed63-483f-9e19-a406471bcc7a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.338832] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.338832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.338832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.338832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.338832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.338832] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.338832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.338832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.339794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.339794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.339794] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a already deleted. [ 1051.339794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.716947] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.716947] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.716947] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.716947] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.716947] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.716947] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 5e910ffd-ed63-483f-9e19-a406471bcc7a not found, creating... [ 1051.718248] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.718248] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.718248] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.718248] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.718248] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.718248] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.718248] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.718248] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.719145] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.719145] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.719307] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 5e910ffd-ed63-483f-9e19-a406471bcc7a is going to be created. [ 1051.741622] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.741850] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.741977] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.742286] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.742630] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.742851] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-5e910ffd-ed63-483f-9e19-a406471bcc7a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.446174] env[65413]: INFO networking_nsxv3.common.synchronization [req-5b831956-c86e-4df5-badb-23a70f417295 req-e97d67d7-930d-4abc-813b-ac38b75be206 service nova] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_rules [ 1052.446407] env[65413]: INFO networking_nsxv3.common.synchronization [req-5b831956-c86e-4df5-badb-23a70f417295 req-e97d67d7-930d-4abc-813b-ac38b75be206 service nova] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1052.446845] env[65413]: INFO networking_nsxv3.common.synchronization [req-5b831956-c86e-4df5-badb-23a70f417295 req-e97d67d7-930d-4abc-813b-ac38b75be206 service nova] Enqueued Resource ID: 5e910ffd-ed63-483f-9e19-a406471bcc7a with Priority: HIGHEST for action port [ 1052.447246] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_rules [ 1052.447350] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1052.447436] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e910ffd-ed63-483f-9e19-a406471bcc7a with Priority: HIGHEST for action port [ 1052.447714] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.447860] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.447920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.448169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.448303] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.449207] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.449331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.449396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.449603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.449716] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.449960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.450049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.450211] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.450603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.450715] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.451521] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e910ffd-ed63-483f-9e19-a406471bcc7a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.451634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e910ffd-ed63-483f-9e19-a406471bcc7a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.451702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e910ffd-ed63-483f-9e19-a406471bcc7a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.452201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e910ffd-ed63-483f-9e19-a406471bcc7a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.452323] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e910ffd-ed63-483f-9e19-a406471bcc7a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.729758] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2eaf869e-a041-4425-9c95-622578933869 in Status: SUCCESS [ 1052.730150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.825584] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a in Status: SUCCESS [ 1052.825768] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.825948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.826254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.826451] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.826589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.826663] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.826818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.826896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.826979] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.827083] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.954961] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.955114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.955349] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.956305] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5e910ffd-ed63-483f-9e19-a406471bcc7a with status ACTIVE [ 1052.956494] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.956624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.956689] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.956938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.957039] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.957221] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.957461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.957503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.957651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.957731] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.957936] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.958040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.958087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.958231] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.958308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.958433] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5e910ffd-ed63-483f-9e19-a406471bcc7a is going to be updated. [ 1052.983412] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.983620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.983675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.983985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.984176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.984673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e910ffd-ed63-483f-9e19-a406471bcc7a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.332856] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.396055] env[65413]: INFO networking_nsxv3.common.synchronization [req-ea67f600-a799-4fa4-9c0d-c24bd05cb685 req-7ca1c28f-904f-407a-9790-ef9294bff534 tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 with Priority: HIGHEST for action security_group_members [ 1053.396611] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 with Priority: HIGHEST for action security_group_members [ 1053.396928] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.397133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.397208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.397458] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.397627] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.397727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.397783] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.397939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.398036] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.398130] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.460613] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.765320] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-210 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.765688] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.765688] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.766037] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.766384] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.766801] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.766801] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.766906] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.767018] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.767245] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.767357] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.767460] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.767565] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.767670] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.767776] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.767896] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.788062] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.788248] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1053.788384] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.788608] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-210" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.788941] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-3a02d043-c97b-4812-8a6f-f19b877fa424 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.789124] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-3a02d043-c97b-4812-8a6f-f19b877fa424" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.789242] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-3a02d043-c97b-4812-8a6f-f19b877fa424" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.789566] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-3a02d043-c97b-4812-8a6f-f19b877fa424" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.789792] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a02d043-c97b-4812-8a6f-f19b877fa424',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.835744] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b7c727cf-c0c3-4630-a13c-00fc005b9b3a: rpc.has_security_group_logging(os_id): False [ 1053.853736] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.853924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.853972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.854196] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.854286] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.854565] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.854673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.854757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.854927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.855055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.855244] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a is going to be created. [ 1053.900407] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.900613] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.900763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.901030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.901121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.901368] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.901618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.901618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.901767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.901820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.901927] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 already deleted. [ 1053.902024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.920512] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.920694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.920760] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.920938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.921131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.932841] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a in Status: IN_PROGRESS for 2s [ 1053.963745] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.963745] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.963745] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.963745] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.963745] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.964038] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be created. [ 1053.997447] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.997853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.997853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.997947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.998075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.012301] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: UNINITIALIZED for 2s [ 1054.292646] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.292975] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.293178] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.293562] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.293767] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.293960] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 3a02d043-c97b-4812-8a6f-f19b877fa424 not found, creating... [ 1054.294301] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.294499] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.294640] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.294876] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.295019] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.295334] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.295494] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.295628] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.295840] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.295986] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.296148] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 3a02d043-c97b-4812-8a6f-f19b877fa424 is going to be created. [ 1054.330191] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.330733] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.330951] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.331278] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.331530] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.331772] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-3a02d043-c97b-4812-8a6f-f19b877fa424" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.096092] env[65413]: INFO networking_nsxv3.common.synchronization [req-ea67f600-a799-4fa4-9c0d-c24bd05cb685 req-9ea9ded6-b74b-448b-94e5-5f6716898509 service nova] Enqueued Resource ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 with Priority: HIGHEST for action security_group_rules [ 1055.096443] env[65413]: INFO networking_nsxv3.common.synchronization [req-ea67f600-a799-4fa4-9c0d-c24bd05cb685 req-9ea9ded6-b74b-448b-94e5-5f6716898509 service nova] Enqueued Resource ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 with Priority: HIGHEST for action security_group_members [ 1055.096866] env[65413]: INFO networking_nsxv3.common.synchronization [req-ea67f600-a799-4fa4-9c0d-c24bd05cb685 req-9ea9ded6-b74b-448b-94e5-5f6716898509 service nova] Enqueued Resource ID: 3a02d043-c97b-4812-8a6f-f19b877fa424 with Priority: HIGHEST for action port [ 1055.097438] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 with Priority: HIGHEST for action security_group_rules [ 1055.097621] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 with Priority: HIGHEST for action security_group_members [ 1055.097746] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a02d043-c97b-4812-8a6f-f19b877fa424 with Priority: HIGHEST for action port [ 1055.098087] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.098249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.098353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.098583] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.098788] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.099679] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.100645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.100645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.100645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.100645] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.100645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.100645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.100645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.100989] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.100989] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.103994] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-3a02d043-c97b-4812-8a6f-f19b877fa424 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.103994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3a02d043-c97b-4812-8a6f-f19b877fa424" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.103994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3a02d043-c97b-4812-8a6f-f19b877fa424" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.103994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3a02d043-c97b-4812-8a6f-f19b877fa424" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.103994] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3a02d043-c97b-4812-8a6f-f19b877fa424',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.604979] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.605623] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.606076] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.606404] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3a02d043-c97b-4812-8a6f-f19b877fa424 with status ACTIVE [ 1055.606404] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.608552] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.608552] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.608552] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.608552] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.608552] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.609310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.609310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.609310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.609310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.609310] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.609580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.609580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.609646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.609800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.611182] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3a02d043-c97b-4812-8a6f-f19b877fa424 is going to be updated. [ 1055.634397] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.634578] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.634638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.634994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.635158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.635539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3a02d043-c97b-4812-8a6f-f19b877fa424" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.949825] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a in Status: SUCCESS [ 1055.950422] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.024348] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1056.024530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.024703] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.024925] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.025456] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.025456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.025456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.025621] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.025621] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.025685] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.026452] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.106751] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.529485] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.529719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.529804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.530094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.530334] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.530488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.530579] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.530823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.530928] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.531057] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.531269] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.531408] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.531479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.531678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.531876] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.531990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.532244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.532453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.532552] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.532653] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.532741] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.609430] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.609620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.609668] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.610331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.610331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.610331] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 is going to be created. [ 1056.639085] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.639085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.639085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.639085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.639538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.653813] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 in Status: UNINITIALIZED for 2s [ 1056.667046] env[65413]: INFO networking_nsxv3.common.synchronization [req-5e56ac6c-d415-460d-856a-69ada3060097 req-23dd4e5e-1330-4384-a821-f7cd567670d2 tempest-ServerRescueNegativeTestJSON-135341842 tempest-ServerRescueNegativeTestJSON-135341842-project-member] Enqueued Resource ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 with Priority: HIGHEST for action security_group_members [ 1056.667696] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 with Priority: HIGHEST for action security_group_members [ 1056.667696] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.667856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.667899] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.668627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.668627] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.668627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.668627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.668627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.668627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.669049] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.035324] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c4cbecb-5529-4a33-ade6-6d4e0203047a: rpc.has_security_group_logging(os_id): False [ 1057.164751] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.165651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.165651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.165651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.165651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.165852] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.165852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.165852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.166064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.166114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.166930] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.166930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.166930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.166930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.166930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.167262] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.167262] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.167416] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.167500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.167719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.167719] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be created. [ 1057.170938] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.171102] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.171153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.171662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.171662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.171662] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.171884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.171884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.172087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.172087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.172172] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 is going to be updated. [ 1057.202504] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.202780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.203035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.203226] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.203460] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.213942] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 in Status: IN_PROGRESS for 2s [ 1057.230918] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.231107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.231196] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.231454] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.231642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.241340] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1058.664107] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 in Status: SUCCESS [ 1058.664107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.664464] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.664464] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.664633] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.664759] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.664811] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.664973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.665066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.665153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.665267] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.168220] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.226654] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 in Status: SUCCESS [ 1059.227025] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 deletion is rescheduled due to dependency. [ 1059.227785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.256013] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1059.256667] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.673153] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8: rpc.has_security_group_logging(os_id): False [ 1059.690762] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.690957] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.691044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.691221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.691324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.691570] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.691673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.691736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.691894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.691969] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.692069] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 is going to be created. [ 1059.750007] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.750007] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.750007] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.750007] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.750007] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.763771] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 in Status: IN_PROGRESS for 2s [ 1061.669040] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1061.669612] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1061.780836] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 in Status: SUCCESS [ 1061.781081] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.739904] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.740383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.740383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.740643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.740832] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.244241] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.746019] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.248646] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1065.248646] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1066.128194] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.128639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.128639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.128878] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.144145] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1066.145219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.146576] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1066.188082] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.188082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.188082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.188082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.195730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.196575] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1066.196680] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1066.196800] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1066.243893] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.243893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.243893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.244056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.245690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.245804] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1066.331853] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.332056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.332133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.332296] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.332674] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.332970] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1066.376455] env[65413]: INFO networking_nsxv3.common.synchronization [req-d16782ed-957d-440f-851e-f201bebc0ff2 req-2f037648-db8c-45d5-a02b-14dc8daccb60 tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_members [ 1066.377102] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_members [ 1066.377422] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.377536] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.377595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.377797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.377944] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.378476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.378622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.378747] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.378836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.378927] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.426863] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.427113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.427351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.427585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.427893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.428204] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:51. [ 1066.428301] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'fcfdc2e3-2cc7-44cc-8355-9f87d267f435', 'b12a08d1-d92e-480d-a458-27ffa6ee6832', '7a6edb0e-97b9-43a5-ad22-81f0519d71f5', '5a0e7d88-1218-4171-a282-a951fc9c1dbb', 'c249e605-e5e9-4e19-9316-502e4084ec60', 'f9d5ed73-228a-4ead-afe1-ed95ca323320', 'edbcf595-e502-4812-b097-93b4e6d1355d', '0c4cbecb-5529-4a33-ade6-6d4e0203047a', 'e7c33cf7-e412-4969-a4ca-045fd79b0e48', '579e1066-bea4-4954-a499-fb0ae75b5375', 'ba978295-db66-4f6f-800c-d69ad3fc5fec', 'bdd0e27d-c1b3-4c8e-bf7a-7837e9769380', 'd31c425c-609d-448d-bad8-0a938d0bf8ef', '9c56a7ec-65f7-4b28-8303-747aa0500c3b', '380e8f44-e830-45ac-b5a4-5ad6b4d43d1e', '69363ac6-cdf1-4edb-9d06-998638037b3e', '650f4003-0da8-43a0-bfde-c7d15e589861', 'cbfb80ba-80ff-4142-b496-98bf89fbe02f', '98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9', 'af248d88-efaa-44cd-99ca-972413455b63', 'af57a10c-d2fd-4a8a-8e67-890fc4b4d689', 'dc6363fa-eea2-4547-9c1c-27fea8439578', 'f4aeeb11-908b-4980-9ebd-3c96e2724ded', 'e66f37bc-ef47-4d76-937b-4d1c38a4ffe7', '065563e4-03b1-4f50-9075-8d4bf2c3fb60', 'b7c727cf-c0c3-4630-a13c-00fc005b9b3a', 'abda67a6-20b2-4d8b-8a37-701a11fb0d75', 'fd87052e-7745-4df2-93d7-5efc42c58438', '2eaf869e-a041-4425-9c95-622578933869', 'bc7b7d78-f994-42d1-964f-0485a67466cc', '7b3bad9e-4f10-4e75-bf3f-69836f779f28', '0022fbcd-322d-4db7-a1a1-6693d137e213', '3d036f63-388f-4a40-b3dc-855ae378cbe3', '185b0179-79b1-4f7f-a796-e81c3eb7726c', '9d35feb8-5ef7-43ac-855e-ecb9d850ee7e', '9b9c29e6-4adf-4695-9f0a-75daeb6daeb9', '8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b', '93ea813f-4897-4022-881c-ff28bf9f5462', '74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100', 'ca89c8be-e3c6-40f6-87a3-7faf3a616f56', '924c9188-b4e7-4597-a445-d583984b729f', '1945c8c9-d5b5-4111-ba8b-cb310537a2d4', 'db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8', 'd96dd8be-7e0f-4527-b6b4-1fd21b89c256', 'cd34bb24-11b2-4ccc-9316-b0c847939508', '2204e101-51b2-465b-9a7b-c28fa89afdc1', '7e429593-1cb3-44b2-8d70-77fbe7afbed5', '58542666-ecc3-4c4c-bed5-143746872487', '62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4', '5d92a9ea-1a70-4bff-aac7-578c2d7396f3', '14ffed21-0b3b-46f2-aece-160a014b9767'} {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1066.428443] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1066.451634] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.451849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.451849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.452101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.452193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.452317] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1066.452399] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1066.452600] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1066.564065] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.564065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.564065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.564498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.565585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.565898] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1066.565994] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1066.566057] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1066.566125] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1066.566200] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/51 resources of Type:Security Group Rules [ 1066.566267] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGH for action security_group_rules [ 1066.566572] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGH for action security_group_rules [ 1066.566572] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGH for action security_group_rules [ 1066.566572] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb with Priority: HIGH for action security_group_rules [ 1066.566572] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGH for action security_group_rules [ 1066.566743] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 with Priority: HIGH for action security_group_rules [ 1066.566743] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGH for action security_group_rules [ 1066.566743] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGH for action security_group_rules [ 1066.566851] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 with Priority: HIGH for action security_group_rules [ 1066.566851] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGH for action security_group_rules [ 1066.566923] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGH for action security_group_rules [ 1066.566961] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 with Priority: HIGH for action security_group_rules [ 1066.567026] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGH for action security_group_rules [ 1066.567090] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGH for action security_group_rules [ 1066.567178] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e with Priority: HIGH for action security_group_rules [ 1066.567289] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGH for action security_group_rules [ 1066.567394] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGH for action security_group_rules [ 1066.567500] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGH for action security_group_rules [ 1066.567609] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 with Priority: HIGH for action security_group_rules [ 1066.567724] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGH for action security_group_rules [ 1066.567856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.703817] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.704035] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.704169] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.704433] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.704702] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.704889] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.705015] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.705235] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.705377] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.705586] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1066.705696] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1066.705801] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1066.705908] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1066.706063] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1066.706184] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1066.706321] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1066.731833] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1066.732074] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1066.732254] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1066.732558] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.733051] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-db3796f3-9b89-4483-94e0-dfdafaa3ed33 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.733259] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-db3796f3-9b89-4483-94e0-dfdafaa3ed33" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.733359] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-db3796f3-9b89-4483-94e0-dfdafaa3ed33" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.733798] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-db3796f3-9b89-4483-94e0-dfdafaa3ed33" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.733969] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db3796f3-9b89-4483-94e0-dfdafaa3ed33',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.881128] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.236832] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.237380] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.237380] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.237508] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.237658] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.237917] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port db3796f3-9b89-4483-94e0-dfdafaa3ed33 not found, creating... [ 1067.238115] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.238276] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.238390] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.238614] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.238770] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.239070] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.239228] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.239340] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.239552] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.239682] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.239816] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: db3796f3-9b89-4483-94e0-dfdafaa3ed33 is going to be created. [ 1067.265545] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.265690] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.265821] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.266107] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.266345] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.266537] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-db3796f3-9b89-4483-94e0-dfdafaa3ed33" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.358246] env[65413]: INFO networking_nsxv3.common.synchronization [req-a89f8b2c-9c05-4a9d-b576-3d7563795ae2 req-8a4e865c-6eef-48ed-ad87-a2ef44219efe tempest-DeleteServersTestJSON-2008533967 tempest-DeleteServersTestJSON-2008533967-project-member] Enqueued Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 1067.358792] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 with Priority: HIGHEST for action security_group_members [ 1067.358942] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 with Priority: HIGH for action security_group_rules [ 1067.359060] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 with Priority: HIGH for action security_group_rules [ 1067.359162] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGH for action security_group_rules [ 1067.359256] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e with Priority: HIGH for action security_group_rules [ 1067.359348] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af248d88-efaa-44cd-99ca-972413455b63 with Priority: HIGH for action security_group_rules [ 1067.359438] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 with Priority: HIGH for action security_group_rules [ 1067.359529] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f with Priority: HIGH for action security_group_rules [ 1067.359619] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 650f4003-0da8-43a0-bfde-c7d15e589861 with Priority: HIGH for action security_group_rules [ 1067.359706] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b with Priority: HIGH for action security_group_rules [ 1067.359793] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 69363ac6-cdf1-4edb-9d06-998638037b3e with Priority: HIGH for action security_group_rules [ 1067.359879] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGH for action security_group_rules [ 1067.359962] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 with Priority: HIGH for action security_group_rules [ 1067.360059] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGH for action security_group_rules [ 1067.360148] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGH for action security_group_rules [ 1067.360236] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 with Priority: HIGH for action security_group_rules [ 1067.360323] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 with Priority: HIGH for action security_group_rules [ 1067.360439] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGH for action security_group_rules [ 1067.360592] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGH for action security_group_rules [ 1067.360699] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 with Priority: HIGH for action security_group_rules [ 1067.360788] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb with Priority: HIGH for action security_group_rules [ 1067.361097] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.361222] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.361286] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.361485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.361729] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.361833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.361934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.362022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.362103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.362191] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d96dd8be-7e0f-4527-b6b4-1fd21b89c256',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.363562] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.363730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.363872] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.363963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.364055] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fcfdc2e3-2cc7-44cc-8355-9f87d267f435',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.364840] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.364932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.364999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.365157] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.365226] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a6edb0e-97b9-43a5-ad22-81f0519d71f5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.366071] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edbcf595-e502-4812-b097-93b4e6d1355d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.366189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.366229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.366379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.366447] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edbcf595-e502-4812-b097-93b4e6d1355d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.367333] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.367333] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.367630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.367630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.367737] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('380e8f44-e830-45ac-b5a4-5ad6b4d43d1e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.368382] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af248d88-efaa-44cd-99ca-972413455b63 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.368487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.368536] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.368651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.368860] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af248d88-efaa-44cd-99ca-972413455b63',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.369607] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.369708] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.369747] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.369931] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.370084] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.370820] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbfb80ba-80ff-4142-b496-98bf89fbe02f taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.370932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.370932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.371051] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.371206] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbfb80ba-80ff-4142-b496-98bf89fbe02f',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.371905] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-650f4003-0da8-43a0-bfde-c7d15e589861 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.372034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.372094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.372312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.372312] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('650f4003-0da8-43a0-bfde-c7d15e589861',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.373296] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.373410] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.373451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.373634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.373780] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9c56a7ec-65f7-4b28-8303-747aa0500c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.374470] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-69363ac6-cdf1-4edb-9d06-998638037b3e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.374585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.374632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.376765] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.376765] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('69363ac6-cdf1-4edb-9d06-998638037b3e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.376765] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.376765] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.376765] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.376765] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.376765] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.377214] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.377912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.377912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.377912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.377912] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bdd0e27d-c1b3-4c8e-bf7a-7837e9769380',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.379603] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba978295-db66-4f6f-800c-d69ad3fc5fec taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.379603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.379603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.379603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.379603] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.379838] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.379838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.379838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.379950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.380039] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.380683] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.381092] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.381155] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.381783] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.381783] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7c33cf7-e412-4969-a4ca-045fd79b0e48',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.382212] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f9d5ed73-228a-4ead-afe1-ed95ca323320 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.382322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.382388] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.382574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.382663] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f9d5ed73-228a-4ead-afe1-ed95ca323320',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.383363] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.383478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.383524] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.383668] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.384658] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.384658] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.384658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.384658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.384983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.384983] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.385981] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b12a08d1-d92e-480d-a458-27ffa6ee6832 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.386792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.386792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.386792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.386792] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b12a08d1-d92e-480d-a458-27ffa6ee6832',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.387117] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5a0e7d88-1218-4171-a282-a951fc9c1dbb taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.387213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.387213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.390616] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.390616] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5a0e7d88-1218-4171-a282-a951fc9c1dbb',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.391630] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.888905] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-edbcf595-e502-4812-b097-93b4e6d1355d taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.889114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.889230] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.889668] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.892141] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.892141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.892141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.892141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.892141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.892141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.892141] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('edbcf595-e502-4812-b097-93b4e6d1355d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.892954] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba978295-db66-4f6f-800c-d69ad3fc5fec taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.893091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.893140] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.893798] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.893798] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.893798] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.893798] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.893798] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.894071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.894071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.894071] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.896201] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.896201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.896201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.896201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.896413] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.896413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.896520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.897158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.897158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.897158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.897158] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.898343] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.898764] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.898764] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.899173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.899173] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.899173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.899309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.899396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.899486] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.899600] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.899699] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.905039] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.905039] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.905039] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.905039] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.905039] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.905039] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.905039] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.906869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.906869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.906869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.906869] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.907160] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.907213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.907250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.907390] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.907534] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.907625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.907684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.907818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.907895] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.909264] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.909264] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.912365] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.912447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.912447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.912698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.925778] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('edbcf595-e502-4812-b097-93b4e6d1355d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.929765] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.930050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.930050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.930679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.930679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.930679] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a is going to be updated. [ 1068.006135] env[65413]: INFO networking_nsxv3.common.synchronization [req-d16782ed-957d-440f-851e-f201bebc0ff2 req-e40192ff-2238-4c56-b0fb-d3c82dbf0ece service nova] Enqueued Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_rules [ 1068.006135] env[65413]: INFO networking_nsxv3.common.synchronization [req-d16782ed-957d-440f-851e-f201bebc0ff2 req-e40192ff-2238-4c56-b0fb-d3c82dbf0ece service nova] Enqueued Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_members [ 1068.006135] env[65413]: INFO networking_nsxv3.common.synchronization [req-d16782ed-957d-440f-851e-f201bebc0ff2 req-e40192ff-2238-4c56-b0fb-d3c82dbf0ece service nova] Enqueued Resource ID: db3796f3-9b89-4483-94e0-dfdafaa3ed33 with Priority: HIGHEST for action port [ 1068.007820] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_rules [ 1068.007820] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_members [ 1068.007820] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db3796f3-9b89-4483-94e0-dfdafaa3ed33 with Priority: HIGHEST for action port [ 1068.007820] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.007820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.007820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.007820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.007820] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.008839] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.008839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.009209] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-db3796f3-9b89-4483-94e0-dfdafaa3ed33 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.009209] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db3796f3-9b89-4483-94e0-dfdafaa3ed33" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.009209] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db3796f3-9b89-4483-94e0-dfdafaa3ed33" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.009451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db3796f3-9b89-4483-94e0-dfdafaa3ed33" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.009581] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db3796f3-9b89-4483-94e0-dfdafaa3ed33',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.024606] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.024959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.030763] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.030965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.032022] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.032161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.032996] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.033389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.034167] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.034276] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.035035] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.035108] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.035997] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.036116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.036805] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.036901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.037605] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.037701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.038362] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.038458] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.039485] env[65413]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.039923] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.040026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.040658] env[65413]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.041071] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.041167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.041828] env[65413]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.042233] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.042347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.042941] env[65413]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.043393] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.043503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.050229] env[65413]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1068.050758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.051056] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.051200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.051278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.051498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.051584] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.051683] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 is going to be updated. [ 1068.053035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.053239] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.085891] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.086151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.086151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.086328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.086480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.103698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.103938] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7c33cf7-e412-4969-a4ca-045fd79b0e48 is going to be deleted. [ 1068.104701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.104952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.107696] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a in Status: IN_PROGRESS for 2s [ 1068.123157] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.124167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.124167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.124167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.124167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.134577] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: IN_PROGRESS for 2s [ 1068.136479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.136609] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbfb80ba-80ff-4142-b496-98bf89fbe02f is going to be deleted. [ 1068.137638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.137856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.166321] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.166502] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9c56a7ec-65f7-4b28-8303-747aa0500c3b is going to be deleted. [ 1068.167510] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.167774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.199566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.199640] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 380e8f44-e830-45ac-b5a4-5ad6b4d43d1e is going to be deleted. [ 1068.200843] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.201122] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.207520] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.207765] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.234532] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.234707] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.252763] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.253218] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.257721] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.257878] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b12a08d1-d92e-480d-a458-27ffa6ee6832 is going to be deleted. [ 1068.258777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.259015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.336403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.336591] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f9d5ed73-228a-4ead-afe1-ed95ca323320 is going to be deleted. [ 1068.337405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.337648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.382280] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.382499] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.396265] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.396501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.420925] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.423311] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.423479] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9 is going to be deleted. [ 1068.424682] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.426277] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.426433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.426505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.426831] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.427022] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.427176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.427267] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.427378] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.427479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.427595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.427807] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.427864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.427943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.428112] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.428272] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.428383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.428625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.428819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.428910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.429028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.429129] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.429940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.430144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.431333] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.431878] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.432471] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.432471] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.432471] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.432471] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.432767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.432808] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.433704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.433704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.433704] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.433704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.433704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.433704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.433704] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.433704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.433704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.434288] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.434288] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.434288] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.434288] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.435157] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.435157] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.435157] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.435368] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.435445] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.435888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.435947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.436094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.436453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.436453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.436453] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.436453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.436671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.436671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.436802] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.436899] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.436936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.437737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.437737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.437737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.437737] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.440570] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for edbcf595-e502-4812-b097-93b4e6d1355d: rpc.has_security_group_logging(os_id): False [ 1068.511484] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.511660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.511795] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db3796f3-9b89-4483-94e0-dfdafaa3ed33 with status ACTIVE [ 1068.511956] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.512088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.512153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.512406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.512575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.512765] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.512864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.512926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.513111] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.513216] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.513364] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.513455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.513554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.513706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.513842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.513889] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db3796f3-9b89-4483-94e0-dfdafaa3ed33 is going to be updated. [ 1068.523033] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.523272] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.541923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.542194] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a6edb0e-97b9-43a5-ad22-81f0519d71f5 is going to be deleted. [ 1068.543237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.543512] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.601609] env[65413]: INFO networking_nsxv3.common.synchronization [req-ba3bcce8-e98d-49a1-a011-04c33a9108a2 req-312c331c-41be-4d50-87bb-2d10a9286fc3 tempest-ServerRescueNegativeTestJSON-135341842 tempest-ServerRescueNegativeTestJSON-135341842-project-member] Enqueued Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_members [ 1068.602221] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_members [ 1068.602607] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.602746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.602818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.602999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.603165] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.603265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.603323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.603473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.603574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.603680] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.608523] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.608658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.608730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.608979] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.609133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.609298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db3796f3-9b89-4483-94e0-dfdafaa3ed33" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.618956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.618956] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bdd0e27d-c1b3-4c8e-bf7a-7837e9769380 is going to be deleted. [ 1068.620484] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.620484] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.678051] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.678051] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fcfdc2e3-2cc7-44cc-8355-9f87d267f435 is going to be deleted. [ 1068.678551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.678780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.723937] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.724204] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.754660] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.754907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.766729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.766897] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 69363ac6-cdf1-4edb-9d06-998638037b3e is going to be deleted. [ 1068.767775] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.768012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.802691] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.802917] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.821330] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.821532] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.849681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.849843] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5a0e7d88-1218-4171-a282-a951fc9c1dbb is going to be deleted. [ 1068.850681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.850896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.923060] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba978295-db66-4f6f-800c-d69ad3fc5fec: rpc.has_security_group_logging(os_id): False [ 1068.927058] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d31c425c-609d-448d-bad8-0a938d0bf8ef: rpc.has_security_group_logging(os_id): False [ 1068.931639] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.931855] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.941499] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c249e605-e5e9-4e19-9316-502e4084ec60: rpc.has_security_group_logging(os_id): False [ 1068.943314] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c4cbecb-5529-4a33-ade6-6d4e0203047a: rpc.has_security_group_logging(os_id): False [ 1068.944807] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 579e1066-bea4-4954-a499-fb0ae75b5375: rpc.has_security_group_logging(os_id): False [ 1068.985035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.985280] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af248d88-efaa-44cd-99ca-972413455b63 is going to be deleted. [ 1068.986990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.987358] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.034032] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.034172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.037189] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.037332] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.055229] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.055370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.056155] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.056253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.059146] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.059242] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.067502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.067674] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 650f4003-0da8-43a0-bfde-c7d15e589861 is going to be deleted. [ 1069.068569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.068817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.068903] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.069060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7c33cf7-e412-4969-a4ca-045fd79b0e48" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.069258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.069385] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.069493] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.069638] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbfb80ba-80ff-4142-b496-98bf89fbe02f" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.070137] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.070317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.070397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.070550] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9c56a7ec-65f7-4b28-8303-747aa0500c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.070730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.070868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.070949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.071092] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-380e8f44-e830-45ac-b5a4-5ad6b4d43d1e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.071529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.071529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.071529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.071529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b12a08d1-d92e-480d-a458-27ffa6ee6832" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.071668] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.071763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.108401] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.141558] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.141766] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.142996] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.143144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.174018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.174838] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.174838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.174838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.174838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.175094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.175094] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edbcf595-e502-4812-b097-93b4e6d1355d is going to be updated. [ 1069.179691] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.179691] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.179803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.180021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f9d5ed73-228a-4ead-afe1-ed95ca323320" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.181230] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.181439] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.181531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.181652] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-98e1bd10-e6e3-49b6-9ff2-a2e07dbcd9c9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.182468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.182688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.182792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.182950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bdd0e27d-c1b3-4c8e-bf7a-7837e9769380" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.183133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.183330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.183448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.183607] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a6edb0e-97b9-43a5-ad22-81f0519d71f5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.184296] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.184500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.184609] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.184777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fcfdc2e3-2cc7-44cc-8355-9f87d267f435" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.185332] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.185514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.254549] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.254916] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.255046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.255117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.255372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.255463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.255598] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef is going to be updated. [ 1069.256846] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.257063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.309971] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.310173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.313102] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.313102] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.323432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.324937] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.324937] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.324937] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.324937] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.324937] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.324937] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.324937] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.324937] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.325642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.325642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.325642] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.325642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.325642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.325901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.326008] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.327242] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1069.327439] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.327893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.396249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.396249] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.396249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.396249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.396614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.396792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.397114] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.397284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.397376] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.397635] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.397766] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.398128] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.398276] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.398431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.398629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.398767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.398924] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c249e605-e5e9-4e19-9316-502e4084ec60 is going to be updated. [ 1069.400534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.400792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.400919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.401118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-69363ac6-cdf1-4edb-9d06-998638037b3e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.401315] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.401555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.454704] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.454704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.495127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.495127] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.495127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.495127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.495127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.495504] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.495504] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba978295-db66-4f6f-800c-d69ad3fc5fec is going to be updated. [ 1069.496937] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.497242] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.497368] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.497538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af248d88-efaa-44cd-99ca-972413455b63" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.497734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.497946] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.498080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.498315] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-650f4003-0da8-43a0-bfde-c7d15e589861" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.498464] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.498678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.498814] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.498965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5a0e7d88-1218-4171-a282-a951fc9c1dbb" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.499148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.499345] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.561249] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.561432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.585346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.585592] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.586551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.586551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.586551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.586551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.586551] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.586551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.586551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.586881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.586881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.586881] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.587010] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.587010] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.587185] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.587260] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.587531] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 1069.588849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.589384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.589384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.590657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.590657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.590877] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.594280] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.594280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.594280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.594280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.594280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.610939] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.648527] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1069.649543] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: IN_PROGRESS for 2s [ 1069.650914] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edbcf595-e502-4812-b097-93b4e6d1355d in Status: IN_PROGRESS for 2s [ 1069.669847] env[65413]: INFO networking_nsxv3.common.synchronization [None req-01b10ab8-e05f-4d7c-9797-48d7e13a5523 tempest-ServerDiskConfigTestJSON-938124936 tempest-ServerDiskConfigTestJSON-938124936-project-member] Enqueued Resource ID: 75cd5450-b100-4d40-98c6-819965ae186d with Priority: HIGHEST for action security_group_rules [ 1069.670683] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75cd5450-b100-4d40-98c6-819965ae186d with Priority: HIGHEST for action security_group_rules [ 1069.672677] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.672951] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.673068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.673392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.673782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.675387] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75cd5450-b100-4d40-98c6-819965ae186d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.675592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75cd5450-b100-4d40-98c6-819965ae186d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.675696] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75cd5450-b100-4d40-98c6-819965ae186d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.675981] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75cd5450-b100-4d40-98c6-819965ae186d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.676124] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75cd5450-b100-4d40-98c6-819965ae186d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.710359] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: IN_PROGRESS for 2s [ 1069.721258] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.721466] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.721511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.721791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.721893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.764300] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: IN_PROGRESS for 2s [ 1069.768323] env[65413]: INFO networking_nsxv3.common.synchronization [None req-a36165c7-a9ea-4ce7-9a4d-eeaca5c6affd tempest-ServerDiskConfigTestJSON-938124936 tempest-ServerDiskConfigTestJSON-938124936-project-member] Enqueued Resource ID: 75cd5450-b100-4d40-98c6-819965ae186d with Priority: HIGHEST for action security_group_rules [ 1069.769170] env[65413]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1069.769703] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.769869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.769936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.770624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.770624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.772053] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75cd5450-b100-4d40-98c6-819965ae186d with Priority: HIGHEST for action security_group_rules [ 1069.772370] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75cd5450-b100-4d40-98c6-819965ae186d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.772463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75cd5450-b100-4d40-98c6-819965ae186d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.808667] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 1070.113796] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.113796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.113796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.114115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.114115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.114199] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c249e605-e5e9-4e19-9316-502e4084ec60 is going to be updated. [ 1070.121849] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a in Status: SUCCESS [ 1070.122103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.122796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.122796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.122796] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.122796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.123151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.123151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.123151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.123300] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.146490] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 in Status: SUCCESS [ 1070.146904] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d96dd8be-7e0f-4527-b6b4-1fd21b89c256 deletion is rescheduled due to dependency. [ 1070.147227] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d96dd8be-7e0f-4527-b6b4-1fd21b89c256" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.149865] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.149992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.150075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.150313] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.150473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.160085] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: IN_PROGRESS for 2s [ 1070.200058] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.200287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.200461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.200725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.200878] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.201062] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75cd5450-b100-4d40-98c6-819965ae186d already deleted. [ 1070.201205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75cd5450-b100-4d40-98c6-819965ae186d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.201448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75cd5450-b100-4d40-98c6-819965ae186d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.201704] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75cd5450-b100-4d40-98c6-819965ae186d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.201854] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75cd5450-b100-4d40-98c6-819965ae186d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.626694] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.723342] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.723529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.723613] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.723846] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.723938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.724067] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75cd5450-b100-4d40-98c6-819965ae186d already deleted. [ 1070.724343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75cd5450-b100-4d40-98c6-819965ae186d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.103126] env[65413]: INFO networking_nsxv3.common.synchronization [req-760bf70a-3615-47d3-9a25-aa95f8bc66db req-2f9098fd-b4ee-4b70-ae32-39deb5b2bfc8 tempest-ServersTestJSON-1291473095 tempest-ServersTestJSON-1291473095-project-member] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1071.103743] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1071.104304] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.104470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.104567] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.104807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.105039] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.105150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.105239] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.105428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.105545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.105670] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.129141] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.500420] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.500743] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.500944] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.501370] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.501649] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.501833] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.501990] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.502274] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.502434] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.502691] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.502803] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1071.503037] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1071.503037] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1071.503148] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.503520] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1071.503520] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1071.528129] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1071.528342] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1071.529035] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1071.529035] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.529236] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-fb19d813-ba58-4abb-8986-8f189f0a1902 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.529361] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-fb19d813-ba58-4abb-8986-8f189f0a1902" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.529544] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-fb19d813-ba58-4abb-8986-8f189f0a1902" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.529979] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-fb19d813-ba58-4abb-8986-8f189f0a1902" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.530229] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb19d813-ba58-4abb-8986-8f189f0a1902',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.607837] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.633333] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.633785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.633785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.633997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.634125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.634253] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a is going to be updated. [ 1071.672946] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1071.673133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.676060] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: SUCCESS [ 1071.676060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.676060] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: edbcf595-e502-4812-b097-93b4e6d1355d in Status: SUCCESS [ 1071.676060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.685545] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.685781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.685781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.685942] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.687033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.700635] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a in Status: IN_PROGRESS for 2s [ 1071.725422] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: SUCCESS [ 1071.725650] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.778428] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: SUCCESS [ 1071.778795] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.833490] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 1071.833724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.033456] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.033456] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.033847] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.034370] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.034370] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.034649] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port fb19d813-ba58-4abb-8986-8f189f0a1902 not found, creating... [ 1072.034708] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.035483] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.035483] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.035483] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.035811] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.035996] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.036147] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.036853] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.036853] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.037240] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.038020] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: fb19d813-ba58-4abb-8986-8f189f0a1902 is going to be created. [ 1072.070366] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.070655] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.070807] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.071121] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.071355] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.071574] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-fb19d813-ba58-4abb-8986-8f189f0a1902" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.111499] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.175187] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: SUCCESS [ 1072.175530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.614298] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.614472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.614472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.614734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.614823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.614941] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1072.648829] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.649291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.649291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.649468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.649586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.659059] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1072.802153] env[65413]: INFO networking_nsxv3.common.synchronization [req-760bf70a-3615-47d3-9a25-aa95f8bc66db req-d1463055-0e24-4210-8704-c555865d0d22 service nova] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_rules [ 1072.802327] env[65413]: INFO networking_nsxv3.common.synchronization [req-760bf70a-3615-47d3-9a25-aa95f8bc66db req-d1463055-0e24-4210-8704-c555865d0d22 service nova] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1072.802462] env[65413]: INFO networking_nsxv3.common.synchronization [req-760bf70a-3615-47d3-9a25-aa95f8bc66db req-d1463055-0e24-4210-8704-c555865d0d22 service nova] Enqueued Resource ID: fb19d813-ba58-4abb-8986-8f189f0a1902 with Priority: HIGHEST for action port [ 1072.803067] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_rules [ 1072.803211] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1072.803304] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb19d813-ba58-4abb-8986-8f189f0a1902 with Priority: HIGHEST for action port [ 1072.803586] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.803717] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.803835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.804008] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.804161] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.805803] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.805803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.805803] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb19d813-ba58-4abb-8986-8f189f0a1902 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.805803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb19d813-ba58-4abb-8986-8f189f0a1902" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.805803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb19d813-ba58-4abb-8986-8f189f0a1902" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.806208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb19d813-ba58-4abb-8986-8f189f0a1902" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.806208] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb19d813-ba58-4abb-8986-8f189f0a1902',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.312028] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.312028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.312028] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fb19d813-ba58-4abb-8986-8f189f0a1902 with status ACTIVE [ 1073.312028] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.312028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.312028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.312028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.312028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.312028] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.312028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.312028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.312028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.312028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.312028] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.313337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.313337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.315373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.315373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.315373] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fb19d813-ba58-4abb-8986-8f189f0a1902 is going to be updated. [ 1073.345443] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.345695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.345695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.345911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.346066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.346221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb19d813-ba58-4abb-8986-8f189f0a1902" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.711642] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a in Status: SUCCESS [ 1073.712186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.712186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.712441] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.712707] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.712844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.712920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.713063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.713143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.713228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.713318] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.926350] env[65413]: INFO networking_nsxv3.common.synchronization [req-64bd6ea8-3a6f-4032-b228-021e74f89a3d req-c2b4d0cd-6366-4ffe-a9a5-81f224146286 tempest-ServerDiskConfigTestJSON-938124936 tempest-ServerDiskConfigTestJSON-938124936-project-member] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1073.927306] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1073.927306] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.927306] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.927306] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.927522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.927602] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.927702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.927762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.927909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.927993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.928167] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.220443] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.433030] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.433030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.433030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.433030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.433030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.433030] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.433030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.433030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.433030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.433030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.433030] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 1074.464373] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.466789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.466789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.466789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.466789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.477240] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 1074.671069] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1074.671383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.671645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.672054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.672247] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.672440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.672608] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.672864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.673056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.673287] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.723382] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b7c727cf-c0c3-4630-a13c-00fc005b9b3a: rpc.has_security_group_logging(os_id): False [ 1074.744058] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.745923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.745923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.746191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.769173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.769511] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.769725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.769725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.770022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.770101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.771020] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a is going to be updated. [ 1074.847581] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.847858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.847858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.848015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.848155] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.865298] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a in Status: IN_PROGRESS for 2s [ 1074.875632] env[65413]: INFO networking_nsxv3.common.synchronization [req-0992467d-13be-44f7-b6b7-32599fc342e8 req-2ed5e124-70b1-441e-9575-9a57a266deef tempest-ServerRescueNegativeTestJSON-135341842 tempest-ServerRescueNegativeTestJSON-135341842-project-member] Enqueued Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_members [ 1074.876020] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGHEST for action security_group_members [ 1074.876373] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.876494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.876558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.876760] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.876912] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.877016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.877082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.877229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.877311] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.877402] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.175402] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.381887] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.382175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.382278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.382731] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.382849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.383108] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.383257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.383324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.383449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.383524] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.383627] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c249e605-e5e9-4e19-9316-502e4084ec60 is going to be updated. [ 1075.419086] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.419469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.419469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.419578] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.419720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.429267] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: IN_PROGRESS for 2s [ 1075.677609] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.816672] env[65413]: INFO networking_nsxv3.common.synchronization [req-a6c934b4-ad4a-42e6-be89-64c4dab20a50 req-f46140bf-7a20-462e-bbcf-7927fb526fb3 tempest-ServerDiskConfigTestJSON-938124936 tempest-ServerDiskConfigTestJSON-938124936-project-member] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1075.817838] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1075.817838] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.817838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.182243] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.182494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.182719] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.182892] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.182956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.183454] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1076.213921] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.214186] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.214345] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.214684] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.214974] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.215174] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.215298] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.215538] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.215697] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.215973] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1076.216133] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1076.216247] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1076.216364] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1076.216539] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1076.216642] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1076.217302] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1076.218552] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.218661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.218727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.218886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.219040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.229732] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1076.238883] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1076.238883] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1076.238883] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1076.239170] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.239227] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-0b68972e-1f72-4a8d-bd78-431d06648001 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.239399] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-0b68972e-1f72-4a8d-bd78-431d06648001" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.239515] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-0b68972e-1f72-4a8d-bd78-431d06648001" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.239846] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-0b68972e-1f72-4a8d-bd78-431d06648001" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.239984] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b68972e-1f72-4a8d-bd78-431d06648001',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.488602] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 1076.489208] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 deletion is rescheduled due to dependency. [ 1076.489852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.490784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.490784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.490784] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.490784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.490784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.491152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.491152] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.491229] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.743014] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.743183] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.743233] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.743969] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.743969] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.743969] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 0b68972e-1f72-4a8d-bd78-431d06648001 not found, creating... [ 1076.744159] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.744448] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.744448] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.744620] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.744780] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.745233] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.745369] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.745489] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.745749] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.745921] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.746393] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 0b68972e-1f72-4a8d-bd78-431d06648001 is going to be created. [ 1076.771196] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.771196] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.771196] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.771648] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.771834] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.772096] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-0b68972e-1f72-4a8d-bd78-431d06648001" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.888274] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a in Status: SUCCESS [ 1076.888274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.993681] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.993972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.993972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.994127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.994374] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.994556] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.994708] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.994781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.995045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.995189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.995381] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 1077.036462] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.037239] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.037239] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.037972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.038242] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.089266] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 1077.440176] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c249e605-e5e9-4e19-9316-502e4084ec60 in Status: SUCCESS [ 1077.440360] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c249e605-e5e9-4e19-9316-502e4084ec60 deletion is rescheduled due to dependency. [ 1077.440509] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.506873] env[65413]: INFO networking_nsxv3.common.synchronization [req-a6c934b4-ad4a-42e6-be89-64c4dab20a50 req-c90a8cd5-e239-4eed-b2a5-39d94552ebfb service nova] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_rules [ 1077.507341] env[65413]: INFO networking_nsxv3.common.synchronization [req-a6c934b4-ad4a-42e6-be89-64c4dab20a50 req-c90a8cd5-e239-4eed-b2a5-39d94552ebfb service nova] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1077.507580] env[65413]: INFO networking_nsxv3.common.synchronization [req-a6c934b4-ad4a-42e6-be89-64c4dab20a50 req-c90a8cd5-e239-4eed-b2a5-39d94552ebfb service nova] Enqueued Resource ID: 0b68972e-1f72-4a8d-bd78-431d06648001 with Priority: HIGHEST for action port [ 1077.508344] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_rules [ 1077.508534] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1077.508725] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b68972e-1f72-4a8d-bd78-431d06648001 with Priority: HIGHEST for action port [ 1077.509272] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.509450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.509552] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.509856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.509972] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.511710] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.511826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.512281] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b68972e-1f72-4a8d-bd78-431d06648001 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.512651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b68972e-1f72-4a8d-bd78-431d06648001" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.512651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b68972e-1f72-4a8d-bd78-431d06648001" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.512787] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b68972e-1f72-4a8d-bd78-431d06648001" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.512904] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b68972e-1f72-4a8d-bd78-431d06648001',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.539299] env[65413]: INFO networking_nsxv3.common.synchronization [None req-0ebc8e7d-5bd2-45d2-8947-ae52843a53c8 None None] Enqueued Resource ID: a9afb1f7-d7e2-42e5-b8a0-303e69a55aff with Priority: HIGHEST for action port [ 1077.540119] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9afb1f7-d7e2-42e5-b8a0-303e69a55aff with Priority: HIGHEST for action port [ 1077.540453] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9afb1f7-d7e2-42e5-b8a0-303e69a55aff taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.540453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9afb1f7-d7e2-42e5-b8a0-303e69a55aff" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.541135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9afb1f7-d7e2-42e5-b8a0-303e69a55aff" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.541135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9afb1f7-d7e2-42e5-b8a0-303e69a55aff" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.541135] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9afb1f7-d7e2-42e5-b8a0-303e69a55aff',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.016110] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.017659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.017659] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0b68972e-1f72-4a8d-bd78-431d06648001 with status ACTIVE [ 1078.017659] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.017978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.017978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.017978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.018085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.018245] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.018338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.018392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.018546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.018623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.018803] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.018892] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.018956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.019144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.019198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.019247] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0b68972e-1f72-4a8d-bd78-431d06648001 is going to be updated. [ 1078.044108] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.044894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.044894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.044894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.044894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.044894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b68972e-1f72-4a8d-bd78-431d06648001" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.045087] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9afb1f7-d7e2-42e5-b8a0-303e69a55aff [ 1078.045243] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.045344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.045405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.045564] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.045643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.045759] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9afb1f7-d7e2-42e5-b8a0-303e69a55aff already deleted. [ 1078.045911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9afb1f7-d7e2-42e5-b8a0-303e69a55aff" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.241155] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1078.241447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.241636] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.241859] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.242073] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.242188] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.242249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.242404] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.242484] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.242623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.242737] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.748871] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.748871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.748871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.748871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.748871] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.748871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.748871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.748871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.748871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.748871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.748871] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.748871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.748871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.748871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.748871] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.748871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.749429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.749429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.749429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.749429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.749429] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.014217] env[65413]: INFO networking_nsxv3.common.synchronization [None req-4342e92f-09d0-49ac-8e97-90fe324a2bfe tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 1079.014455] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 1079.014762] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.014890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.014966] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.016350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.016350] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.016350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.016350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.016350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.016350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.016906] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.068283] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 1079.068488] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 deletion is rescheduled due to dependency. [ 1079.068571] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.068735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.068961] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.069155] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.069275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.069340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.069499] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.069573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.069669] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.250851] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c4cbecb-5529-4a33-ade6-6d4e0203047a: rpc.has_security_group_logging(os_id): False [ 1079.274135] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.275781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.275892] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.276240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.276382] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.276689] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.276821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.276886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.277064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.277143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.277332] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.277427] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.277491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.277648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.277710] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.277897] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.277988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.278183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.278416] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.278416] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.278939] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1079.348042] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.348190] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.348244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.348446] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.348599] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.363448] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1079.519655] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.519816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.520016] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.520149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.550655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.551015] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.551261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.551261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.551683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.551777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.551880] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be updated. [ 1079.571752] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.591392] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.591516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.591516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.591688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.591822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.605344] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 1080.074903] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.314182] env[65413]: INFO networking_nsxv3.common.synchronization [None req-34525d12-60f5-492c-83ef-ab74aa074d40 None None] Enqueued Resource ID: 343ea796-5a73-4947-9c8c-02b76e55157a with Priority: HIGHEST for action port [ 1080.315109] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 343ea796-5a73-4947-9c8c-02b76e55157a with Priority: HIGHEST for action port [ 1080.315720] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-343ea796-5a73-4947-9c8c-02b76e55157a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.315907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-343ea796-5a73-4947-9c8c-02b76e55157a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.315907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-343ea796-5a73-4947-9c8c-02b76e55157a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.316299] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-343ea796-5a73-4947-9c8c-02b76e55157a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.316933] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('343ea796-5a73-4947-9c8c-02b76e55157a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.579777] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.580014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.580076] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.580279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.580368] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.580772] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 1080.623574] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.623720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.623788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.624014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.624158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.636090] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 1080.824028] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 343ea796-5a73-4947-9c8c-02b76e55157a [ 1080.824028] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.824028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.824028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.824028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.824028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.824028] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:343ea796-5a73-4947-9c8c-02b76e55157a already deleted. [ 1080.824028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-343ea796-5a73-4947-9c8c-02b76e55157a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.390183] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1081.390183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.617524] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 1081.617524] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 deletion is rescheduled due to dependency. [ 1081.617524] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.650805] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 1082.651237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.651474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.651745] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.652011] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.653268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.653396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.653671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.653833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.654011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.654188] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.156914] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.157151] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.157253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.157511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.157758] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.157963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.158071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.158282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.158932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.158932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.158932] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.158932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.158932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.159188] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.159280] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.159407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.159484] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.159671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.159745] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.159848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.159947] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.664640] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 579e1066-bea4-4954-a499-fb0ae75b5375: rpc.has_security_group_logging(os_id): False [ 1083.684702] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.684857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.685060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.685321] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.685445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.686479] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.686479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.686479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.686479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.686479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.686479] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.686479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.686479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.686770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.686770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.686885] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.686990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.687532] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.687959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.687959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.687959] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 1083.809560] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.809863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.809944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.810267] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.811028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.831917] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 1084.902706] env[65413]: INFO networking_nsxv3.common.synchronization [req-be5870d1-231e-498b-bf8b-2c46b7ddff7d req-b8e9bb81-42ca-4ab7-82c2-6318b666c73e tempest-ServersTestJSON-1291473095 tempest-ServersTestJSON-1291473095-project-member] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1084.903323] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1084.903672] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.903847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.904256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.904256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.904438] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.904438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.904514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.905133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.905133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.905133] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.409277] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.744525] env[65413]: INFO networking_nsxv3.common.synchronization [req-6bfd247c-748c-43cc-9b00-b127df911b44 req-8ca6b925-4723-49d9-80aa-5296cb699b4a tempest-InstanceActionsNegativeTestJSON-2078401039 tempest-InstanceActionsNegativeTestJSON-2078401039-project-member] Enqueued Resource ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e with Priority: HIGHEST for action security_group_members [ 1085.745134] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e with Priority: HIGHEST for action security_group_members [ 1085.745467] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.745589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.745657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.745963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.746142] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.746251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.746314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.746473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.746558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.746647] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c42fa4ec-a6a4-414a-a7fe-8a021fbde28e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.849772] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 1085.850476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.911446] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.090444] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-781 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.090649] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-781" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.090766] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-781" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.091157] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-781" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.091417] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.091576] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.091689] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.092302] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.092302] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.092302] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1086.092533] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1086.092533] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1086.092587] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1086.092812] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1086.092812] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1086.092950] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1086.112077] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1086.112265] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1086.112395] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1086.112571] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-781" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.112942] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-b6fae720-0216-490d-808e-6c0edb0da7b0 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.113127] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-b6fae720-0216-490d-808e-6c0edb0da7b0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.113248] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-b6fae720-0216-490d-808e-6c0edb0da7b0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.113653] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-b6fae720-0216-490d-808e-6c0edb0da7b0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.113808] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6fae720-0216-490d-808e-6c0edb0da7b0',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.248735] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.248922] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.248960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.249204] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.249311] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.249513] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.249628] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.249665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.249801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.249874] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.249955] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e already deleted. [ 1086.250049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.417364] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.417519] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.417560] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.417771] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.417889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.418048] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1086.454811] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.454982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.455043] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.455248] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.455396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.466847] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1086.616986] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.617231] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.617231] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.617449] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.617595] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.617747] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port b6fae720-0216-490d-808e-6c0edb0da7b0 not found, creating... [ 1086.618054] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.618305] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.618486] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.618829] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.619000] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.619352] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.619514] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.619626] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.619838] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.619998] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.620174] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: b6fae720-0216-490d-808e-6c0edb0da7b0 is going to be created. [ 1086.643174] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.643440] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.643587] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.643881] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.644142] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.644373] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-b6fae720-0216-490d-808e-6c0edb0da7b0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.422086] env[65413]: INFO networking_nsxv3.common.synchronization [req-6bfd247c-748c-43cc-9b00-b127df911b44 req-97e81c5a-8cea-4400-89cf-bab63615d74c service nova] Enqueued Resource ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e with Priority: HIGHEST for action security_group_rules [ 1087.422086] env[65413]: INFO networking_nsxv3.common.synchronization [req-6bfd247c-748c-43cc-9b00-b127df911b44 req-97e81c5a-8cea-4400-89cf-bab63615d74c service nova] Enqueued Resource ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e with Priority: HIGHEST for action security_group_members [ 1087.422519] env[65413]: INFO networking_nsxv3.common.synchronization [req-6bfd247c-748c-43cc-9b00-b127df911b44 req-97e81c5a-8cea-4400-89cf-bab63615d74c service nova] Enqueued Resource ID: b6fae720-0216-490d-808e-6c0edb0da7b0 with Priority: HIGHEST for action port [ 1087.422782] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e with Priority: HIGHEST for action security_group_rules [ 1087.422919] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e with Priority: HIGHEST for action security_group_members [ 1087.423893] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6fae720-0216-490d-808e-6c0edb0da7b0 with Priority: HIGHEST for action port [ 1087.423893] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.423893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.423893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.423893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.424214] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c42fa4ec-a6a4-414a-a7fe-8a021fbde28e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.426920] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.427551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.427551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.427551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.427551] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.427781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.427781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.427781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.427904] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.428104] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c42fa4ec-a6a4-414a-a7fe-8a021fbde28e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.429034] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6fae720-0216-490d-808e-6c0edb0da7b0 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.429034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6fae720-0216-490d-808e-6c0edb0da7b0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.429034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6fae720-0216-490d-808e-6c0edb0da7b0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.429197] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6fae720-0216-490d-808e-6c0edb0da7b0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.429300] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6fae720-0216-490d-808e-6c0edb0da7b0',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.931511] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c42fa4ec-a6a4-414a-a7fe-8a021fbde28e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.932283] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.932414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.932754] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6fae720-0216-490d-808e-6c0edb0da7b0 with status ACTIVE [ 1087.933398] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.933398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.933398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.933398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.933398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.933598] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.933598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.933667] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.933824] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.933900] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.934083] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.934179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.934250] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.934374] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.934445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.934527] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6fae720-0216-490d-808e-6c0edb0da7b0 is going to be updated. [ 1087.969421] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.969565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.969674] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.969920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.970078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.970237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6fae720-0216-490d-808e-6c0edb0da7b0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.434294] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c42fa4ec-a6a4-414a-a7fe-8a021fbde28e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.477851] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1088.478111] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.936489] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.936657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.936732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.936961] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.937138] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.937195] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e is going to be created. [ 1088.962159] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.962366] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.962366] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.962566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.962755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.972953] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e in Status: UNINITIALIZED for 2s [ 1090.984203] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e in Status: SUCCESS [ 1090.984550] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.984604] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.984823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.985069] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.985210] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.985254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.985467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.985553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.985667] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.985913] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c42fa4ec-a6a4-414a-a7fe-8a021fbde28e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.488576] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.488694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.488758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.488986] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.489169] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.489276] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.489339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.489496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.489584] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.489669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.489812] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.489908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.489964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.490119] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.490252] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.490341] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.490400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.490534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.490622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.490723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.490812] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c42fa4ec-a6a4-414a-a7fe-8a021fbde28e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.994168] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c42fa4ec-a6a4-414a-a7fe-8a021fbde28e: rpc.has_security_group_logging(os_id): False [ 1092.018945] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.019158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.019232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.019450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.019534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.019867] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.019980] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.020055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.020218] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.020293] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.020490] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.020749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.020826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.021026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.021093] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.021278] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.021381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.021481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.021567] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.021685] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.021774] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e is going to be created. [ 1092.106379] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.106379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.106379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.106682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.106732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.119616] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e in Status: IN_PROGRESS for 2s [ 1092.423954] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1092.424137] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1094.096142] env[65413]: INFO networking_nsxv3.common.synchronization [req-c1cfa2bb-17e1-4f06-b7f7-749cbb361b74 req-55df3846-7b0e-4894-8657-20f01bc272b0 tempest-ServerActionsV293TestJSON-598190869 tempest-ServerActionsV293TestJSON-598190869-project-member] Enqueued Resource ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 with Priority: HIGHEST for action security_group_members [ 1094.096404] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 with Priority: HIGHEST for action security_group_members [ 1094.096599] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-065563e4-03b1-4f50-9075-8d4bf2c3fb60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.096718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.096787] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.097025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.097291] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.097554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.097554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.098485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.098485] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.098485] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('065563e4-03b1-4f50-9075-8d4bf2c3fb60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.136681] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e in Status: SUCCESS [ 1094.136913] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.600592] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.600814] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.600941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.601256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.626365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.626706] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.627150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.627150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.627252] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.627348] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.627453] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 is going to be updated. [ 1094.672302] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.672880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.673101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.673446] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.673627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.684594] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 in Status: IN_PROGRESS for 2s [ 1095.030201] env[65413]: INFO networking_nsxv3.common.synchronization [req-dc414a2e-956b-45e9-aeb8-7fba197f49bf req-f1c83f1f-92d9-4e92-b72d-7f540dde5dcb tempest-ServersTestJSON-1291473095 tempest-ServersTestJSON-1291473095-project-member] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1095.030997] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1095.031436] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.031978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.032118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.032417] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.034748] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.035398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.035398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.035398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.035398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.035583] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.413024] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.413351] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.413497] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.413876] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.414685] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.414919] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.415122] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.415467] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.415638] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.415951] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.416142] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.416307] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.416473] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.416642] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.416808] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.417036] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.440060] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.440060] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.440060] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.440060] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.440060] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-bbc75585-0f8b-42ae-92a1-9908495924b9 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.440060] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-bbc75585-0f8b-42ae-92a1-9908495924b9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.440060] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-bbc75585-0f8b-42ae-92a1-9908495924b9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.440437] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-bbc75585-0f8b-42ae-92a1-9908495924b9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.440437] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbc75585-0f8b-42ae-92a1-9908495924b9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.537852] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.943847] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.944156] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.944352] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.944691] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.944848] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.945137] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port bbc75585-0f8b-42ae-92a1-9908495924b9 not found, creating... [ 1095.945463] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.945666] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.945803] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.946065] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.946222] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.946645] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.946764] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.946874] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.947489] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.947489] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.947617] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: bbc75585-0f8b-42ae-92a1-9908495924b9 is going to be created. [ 1096.038846] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.067993] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.067993] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.068232] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.068397] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.068621] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.068910] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-bbc75585-0f8b-42ae-92a1-9908495924b9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.327431] env[65413]: INFO networking_nsxv3.common.synchronization [req-8e6e1f24-02de-4140-8f9d-c2de668ccb58 req-87bcf043-feb6-4f0b-bc0d-e2efed4fc7c7 tempest-ServersV294TestFqdnHostnames-208752401 tempest-ServersV294TestFqdnHostnames-208752401-project-member] Enqueued Resource ID: 2eaf869e-a041-4425-9c95-622578933869 with Priority: HIGHEST for action security_group_members [ 1096.328018] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eaf869e-a041-4425-9c95-622578933869 with Priority: HIGHEST for action security_group_members [ 1096.328409] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-2eaf869e-a041-4425-9c95-622578933869 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.328540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.328633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.328844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.329521] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.329521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.329521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.329521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.329521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.329521] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2eaf869e-a041-4425-9c95-622578933869',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.541384] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.541678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.541678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.541842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.541932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.542047] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1096.574877] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.574964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.575080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.575284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.575442] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.584897] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1096.690052] env[65413]: INFO networking_nsxv3.common.synchronization [req-dc414a2e-956b-45e9-aeb8-7fba197f49bf req-42531ad2-ab9d-48ed-90e6-7fa316bce5ea service nova] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_rules [ 1096.690283] env[65413]: INFO networking_nsxv3.common.synchronization [req-dc414a2e-956b-45e9-aeb8-7fba197f49bf req-42531ad2-ab9d-48ed-90e6-7fa316bce5ea service nova] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1096.690349] env[65413]: INFO networking_nsxv3.common.synchronization [req-dc414a2e-956b-45e9-aeb8-7fba197f49bf req-42531ad2-ab9d-48ed-90e6-7fa316bce5ea service nova] Enqueued Resource ID: bbc75585-0f8b-42ae-92a1-9908495924b9 with Priority: HIGHEST for action port [ 1096.690984] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_rules [ 1096.691192] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1096.691291] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbc75585-0f8b-42ae-92a1-9908495924b9 with Priority: HIGHEST for action port [ 1096.691583] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.691698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.691750] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.692324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.692324] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.692949] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.693072] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.693272] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbc75585-0f8b-42ae-92a1-9908495924b9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.693375] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbc75585-0f8b-42ae-92a1-9908495924b9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.693440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbc75585-0f8b-42ae-92a1-9908495924b9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.693747] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbc75585-0f8b-42ae-92a1-9908495924b9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.693747] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbc75585-0f8b-42ae-92a1-9908495924b9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.698862] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 in Status: SUCCESS [ 1096.699044] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 deletion is rescheduled due to dependency. [ 1096.699150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.832781] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.832946] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.833027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.833249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.855354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.855653] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.855795] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.855868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.856125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.856223] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.856311] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2eaf869e-a041-4425-9c95-622578933869 is going to be updated. [ 1096.886199] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.886348] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.886418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.886642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.886803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.904784] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2eaf869e-a041-4425-9c95-622578933869 in Status: IN_PROGRESS for 2s [ 1097.199078] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.199078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.199078] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bbc75585-0f8b-42ae-92a1-9908495924b9 with status ACTIVE [ 1097.199078] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.199078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.199078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.199078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.199078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.199078] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.199078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.199078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.199078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.199078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.199078] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.199662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.199662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.199662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.199662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.199662] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bbc75585-0f8b-42ae-92a1-9908495924b9 is going to be updated. [ 1097.241434] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.241434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.241434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.241946] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.242450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.242969] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbc75585-0f8b-42ae-92a1-9908495924b9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.616025] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.616025] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.618167] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.618167] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.618167] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.618167] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.618167] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.618167] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.618167] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.618167] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1097.618167] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1097.618610] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1097.618610] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1097.618610] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1097.618610] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1097.618610] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1097.641026] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1097.641226] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1097.641369] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1097.641674] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.642075] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.642326] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.642465] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.642848] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.642986] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52f0b8da-5d14-46d6-bcbd-5c32d84f68d0',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.147192] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.147467] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.147596] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.147965] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.148135] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.148288] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 52f0b8da-5d14-46d6-bcbd-5c32d84f68d0 not found, creating... [ 1098.148554] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.148709] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.148822] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.149057] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.149193] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.149551] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.149808] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.149991] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.150318] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.150514] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.150737] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 52f0b8da-5d14-46d6-bcbd-5c32d84f68d0 is going to be created. [ 1098.173633] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.173861] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.173970] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.174267] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.174490] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.174708] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.596996] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1098.597285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.597526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.597809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.598043] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.598131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.598189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.598346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.598440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.598536] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.915660] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2eaf869e-a041-4425-9c95-622578933869 in Status: SUCCESS [ 1098.916011] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2eaf869e-a041-4425-9c95-622578933869 deletion is rescheduled due to dependency. [ 1098.916011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.919244] env[65413]: INFO networking_nsxv3.common.synchronization [req-77bc83b9-a4a1-4f22-b881-42005315e6b0 req-6294a747-a694-47f6-bf3c-61a555170b1d service nova] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_rules [ 1098.919405] env[65413]: INFO networking_nsxv3.common.synchronization [req-77bc83b9-a4a1-4f22-b881-42005315e6b0 req-6294a747-a694-47f6-bf3c-61a555170b1d service nova] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 1098.919536] env[65413]: INFO networking_nsxv3.common.synchronization [req-77bc83b9-a4a1-4f22-b881-42005315e6b0 req-6294a747-a694-47f6-bf3c-61a555170b1d service nova] Enqueued Resource ID: 52f0b8da-5d14-46d6-bcbd-5c32d84f68d0 with Priority: HIGHEST for action port [ 1098.919755] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_rules [ 1098.919877] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 1098.919968] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f0b8da-5d14-46d6-bcbd-5c32d84f68d0 with Priority: HIGHEST for action port [ 1098.920504] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.920623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.920688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.920911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.920989] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.921794] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.921903] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.921965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.922148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.922292] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.922384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.922444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.922583] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.922789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.922863] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.923667] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.923812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.923893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.924072] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.924351] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52f0b8da-5d14-46d6-bcbd-5c32d84f68d0',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.100477] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.425882] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.426922] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.427049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.427209] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52f0b8da-5d14-46d6-bcbd-5c32d84f68d0 with status ACTIVE [ 1099.427364] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.427468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.427533] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.427797] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.427832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.428105] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.428105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.428196] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.428278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.428353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.428524] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.428617] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.428678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.428815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.428888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.428969] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52f0b8da-5d14-46d6-bcbd-5c32d84f68d0 is going to be updated. [ 1099.452787] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.452953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.453111] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.453280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.453418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.453641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.602534] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.931075] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.975725] env[65413]: INFO networking_nsxv3.common.synchronization [req-0f40a17a-07e5-4052-9ad9-5ba920507a0e req-5dfa1ec0-1686-4e42-b774-5da7fa23e775 tempest-InstanceActionsNegativeTestJSON-2078401039 tempest-InstanceActionsNegativeTestJSON-2078401039-project-member] Enqueued Resource ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e with Priority: HIGHEST for action security_group_members [ 1099.975725] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e with Priority: HIGHEST for action security_group_members [ 1099.977012] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.977146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.977278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.977407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.978127] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.978127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.978127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.978127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.978127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.978127] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c42fa4ec-a6a4-414a-a7fe-8a021fbde28e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.165079] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.165322] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.165487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.165814] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.166013] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.166157] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1100.202175] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.202421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.202421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.202605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.202787] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.216041] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1100.434060] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.434335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.434445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.434718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.434813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.434918] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be updated. [ 1100.474356] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.474522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.476170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.476170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.476170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.483997] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.484195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.484268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.484509] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.484600] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.484818] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.485086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.485160] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.485324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.485401] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.485493] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e is going to be updated. [ 1100.493769] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 1100.546145] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.546347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.546388] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.546587] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.546721] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.558064] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e in Status: IN_PROGRESS for 2s [ 1102.227272] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 4s [ 1102.505492] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 1102.505700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.505871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.506132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.506331] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.506455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.506520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.506674] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.506754] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.506839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.506928] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.568888] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e in Status: SUCCESS [ 1102.569101] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e deletion is rescheduled due to dependency. [ 1102.569883] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.009591] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.009836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.009919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.010287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.010479] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.010608] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.010786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.011046] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.011126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.011223] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.011394] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.011487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.011546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.011703] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.011887] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.012024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.012271] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.012324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.012444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.012579] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.012800] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.519416] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abda67a6-20b2-4d8b-8a37-701a11fb0d75: rpc.has_security_group_logging(os_id): False [ 1103.541578] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.541727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.541941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.542201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.542295] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.542554] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.542703] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.542772] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.542948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.543048] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.543255] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.543345] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.543448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.543539] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.543610] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.543846] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.543911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.543998] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.544117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.544190] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.544273] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be updated. [ 1103.634061] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.634061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.634061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.634326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.634390] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.652249] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 1104.239924] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1104.240295] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.240562] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.240940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.241259] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.241460] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.241552] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.241826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.241942] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.242075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.242216] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.745176] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.745656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.745656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.745656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.745843] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.745931] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.746035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.746232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.746317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.746417] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.746579] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.746669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.746733] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.746881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.747025] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.747118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.747168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.747335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.747396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.747495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.747582] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.976376] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1104.976476] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1105.250482] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c4cbecb-5529-4a33-ade6-6d4e0203047a: rpc.has_security_group_logging(os_id): False [ 1105.272414] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.272414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.272414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.272622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.272622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.273015] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.273215] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.273339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.273585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.273779] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.274123] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.274219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.274324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.274775] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.274775] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.275018] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.275187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.275292] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.275532] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.275673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.275832] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1105.340422] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.340618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.340715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.341197] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.341197] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.359062] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1105.668928] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 1105.669173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.377478] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1107.377869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.845692] env[65413]: INFO networking_nsxv3.common.synchronization [req-973fa200-4adb-4b4f-ae4b-46e3247fdc1c req-ef87ae8e-8a83-4fb4-90f1-8313c0eddfe4 tempest-ServersTestJSON-1291473095 tempest-ServersTestJSON-1291473095-project-member] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1107.845692] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1107.846243] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.846243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.846243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.846559] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.846559] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.846723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.846798] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.846956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.847065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.847145] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.349980] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.852599] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.355596] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.355777] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.355820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.356061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.356162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.356263] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1109.385538] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.385679] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.385749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.385974] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.386157] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.395707] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1111.407592] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1111.407894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.846245] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1112.846710] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1115.804032] env[65413]: INFO networking_nsxv3.common.synchronization [req-19aba063-0230-414f-9ea5-cadf37ad53ea req-311c4c27-ecac-49b4-b13e-16dfe06558ac tempest-ServerActionsTestJSON-1087044681 tempest-ServerActionsTestJSON-1087044681-project-member] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 1115.805417] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 1115.805842] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.805928] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.806014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.806266] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.806443] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.806545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.806605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.807249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.807249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.807249] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.310623] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.310623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.310623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.310623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.310921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.310921] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.311026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.311851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.311851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.311851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.311851] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef is going to be updated. [ 1116.343353] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.343551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.343551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.343757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.343880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.353452] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: IN_PROGRESS for 2s [ 1116.649725] env[65413]: INFO networking_nsxv3.common.synchronization [req-dad62de8-700d-4a83-8ff9-dc42a9910482 req-97afaec2-9b37-4ac9-af94-ead1b37e43c7 tempest-ListServerFiltersTestJSON-481585564 tempest-ListServerFiltersTestJSON-481585564-project-member] Enqueued Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1116.649725] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1116.649725] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.649725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.649725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.650045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.650045] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.650766] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.650901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.651123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.651218] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.651316] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.981187] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-807 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.981518] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-807" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.981518] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-807" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.982240] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-807" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.982240] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.982240] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.982451] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.982583] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.982776] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.983027] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.983148] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.983255] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.983356] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.983478] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.983561] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.983688] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.003537] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.003919] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1117.004101] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.004340] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-807" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.004859] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-efab6a1a-74c8-4194-8273-ef496db3ff15 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.005054] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-efab6a1a-74c8-4194-8273-ef496db3ff15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.005211] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-efab6a1a-74c8-4194-8273-ef496db3ff15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.005671] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-efab6a1a-74c8-4194-8273-ef496db3ff15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.005852] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efab6a1a-74c8-4194-8273-ef496db3ff15',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.020095] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-510 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.020095] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.020095] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.020095] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.020095] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.020346] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.020346] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.020500] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.020635] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.020847] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1117.021076] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1117.021207] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1117.021309] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1117.021421] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1117.021524] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1117.021654] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1117.064299] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1117.064477] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1117.064606] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1117.064781] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-510" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.065323] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.065536] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.065662] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.065942] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.066092] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52f0b8da-5d14-46d6-bcbd-5c32d84f68d0',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.153339] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.153472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.153545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.153765] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.153879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.154127] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.154244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.154282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.154438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.154516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.154602] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8645530-de9a-4187-9078-4d9ec14cdb6b already deleted. [ 1117.154682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.508904] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.509151] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.509291] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.509576] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.509721] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.509870] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port efab6a1a-74c8-4194-8273-ef496db3ff15 not found, creating... [ 1117.510149] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.510303] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.510420] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.510634] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.510768] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.511065] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.511222] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.511349] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.511552] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.511683] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.511818] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: efab6a1a-74c8-4194-8273-ef496db3ff15 is going to be created. [ 1117.531114] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.531685] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.531851] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.532127] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.532351] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.532560] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-efab6a1a-74c8-4194-8273-ef496db3ff15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.569040] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.569287] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.569418] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.569722] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.569877] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.570201] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.570366] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.570486] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.570707] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.570887] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.571218] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.571381] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.571498] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.571710] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.571844] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.571984] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 52f0b8da-5d14-46d6-bcbd-5c32d84f68d0 is going to be updated. [ 1117.606402] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.606620] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.606762] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.607082] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.607284] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.607501] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.239944] env[65413]: INFO networking_nsxv3.common.synchronization [req-dad62de8-700d-4a83-8ff9-dc42a9910482 req-04860325-0a1d-4709-b934-525de7071e1b service nova] Enqueued Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_rules [ 1118.240194] env[65413]: INFO networking_nsxv3.common.synchronization [req-dad62de8-700d-4a83-8ff9-dc42a9910482 req-04860325-0a1d-4709-b934-525de7071e1b service nova] Enqueued Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1118.240276] env[65413]: INFO networking_nsxv3.common.synchronization [req-dad62de8-700d-4a83-8ff9-dc42a9910482 req-04860325-0a1d-4709-b934-525de7071e1b service nova] Enqueued Resource ID: efab6a1a-74c8-4194-8273-ef496db3ff15 with Priority: HIGHEST for action port [ 1118.242549] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_rules [ 1118.242702] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1118.242846] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efab6a1a-74c8-4194-8273-ef496db3ff15 with Priority: HIGHEST for action port [ 1118.243406] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.243530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.243599] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.243871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.243986] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.245115] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.246275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.246275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.250827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.252508] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.252508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.252508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.252508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.252508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.252508] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.257033] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-efab6a1a-74c8-4194-8273-ef496db3ff15 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.257033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efab6a1a-74c8-4194-8273-ef496db3ff15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.257033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efab6a1a-74c8-4194-8273-ef496db3ff15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.257033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efab6a1a-74c8-4194-8273-ef496db3ff15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.257033] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efab6a1a-74c8-4194-8273-ef496db3ff15',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.272416] env[65413]: INFO networking_nsxv3.common.synchronization [req-037318b7-eee9-4e3e-a98b-fe6a65a41dfd req-e3730030-1e98-4ddb-92f0-07b6606f663a service nova] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_rules [ 1118.272657] env[65413]: INFO networking_nsxv3.common.synchronization [req-037318b7-eee9-4e3e-a98b-fe6a65a41dfd req-e3730030-1e98-4ddb-92f0-07b6606f663a service nova] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 1118.272828] env[65413]: INFO networking_nsxv3.common.synchronization [req-037318b7-eee9-4e3e-a98b-fe6a65a41dfd req-e3730030-1e98-4ddb-92f0-07b6606f663a service nova] Enqueued Resource ID: 52f0b8da-5d14-46d6-bcbd-5c32d84f68d0 with Priority: HIGHEST for action port [ 1118.273970] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_rules [ 1118.274143] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 1118.274245] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52f0b8da-5d14-46d6-bcbd-5c32d84f68d0 with Priority: HIGHEST for action port [ 1118.275788] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.275882] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.275882] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.276103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.276188] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.277402] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.277550] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.277656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.277804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.278577] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.279586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.279586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.279586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.279586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.279586] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.279874] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.279931] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.279988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.280172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.280253] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52f0b8da-5d14-46d6-bcbd-5c32d84f68d0',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.364608] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: SUCCESS [ 1118.364799] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef deletion is rescheduled due to dependency. [ 1118.364913] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.560261] env[65413]: INFO networking_nsxv3.common.synchronization [req-8c82495c-cc0b-4c24-b951-50872b6def2d req-37e69fc4-87e7-48d4-9804-7efe05548e94 tempest-ServerDiskConfigTestJSON-938124936 tempest-ServerDiskConfigTestJSON-938124936-project-member] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1118.560426] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1118.560843] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.561022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.561206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.561949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.561949] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.561949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.561949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.561949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.561949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.562203] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.757681] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.759048] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.759226] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.759654] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port efab6a1a-74c8-4194-8273-ef496db3ff15 with status ACTIVE [ 1118.759872] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.760025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.760115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.760465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.760568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.760800] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.760963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.761047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.761201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.761309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.761560] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.761689] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.761773] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.761960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.762077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.762188] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: efab6a1a-74c8-4194-8273-ef496db3ff15 is going to be updated. [ 1118.783998] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.784173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.784214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.784422] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.784564] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.784760] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efab6a1a-74c8-4194-8273-ef496db3ff15" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.785105] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.785194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.785636] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.786435] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52f0b8da-5d14-46d6-bcbd-5c32d84f68d0 with status ACTIVE [ 1118.786598] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.786701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.786766] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.786935] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.787033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.787256] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.787363] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.787424] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.787570] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.787643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.787816] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.787907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.787967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.788127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.788226] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.788311] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52f0b8da-5d14-46d6-bcbd-5c32d84f68d0 is going to be updated. [ 1118.814099] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.814277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.814381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.814598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.814732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.814883] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52f0b8da-5d14-46d6-bcbd-5c32d84f68d0" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.064755] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.064930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.064974] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.065227] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.065325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.065538] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.065641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.065815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.065891] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.065939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.065982] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 1119.098456] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.098456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.098456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.098659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.098764] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.109171] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 1119.117924] env[65413]: INFO networking_nsxv3.common.synchronization [req-2d3495ab-87c8-4a79-a422-e53f1f6e6ed0 req-fa879665-8d3f-4952-9200-4146f61160a8 tempest-AttachVolumeNegativeTest-1303918197 tempest-AttachVolumeNegativeTest-1303918197-project-member] Enqueued Resource ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 with Priority: HIGHEST for action security_group_members [ 1119.118537] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 with Priority: HIGHEST for action security_group_members [ 1119.118917] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.119037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.119468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.119468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.119468] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.119611] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.119611] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.119749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.119829] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.119919] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.261349] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.289745] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.622549] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.622697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.622762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.623080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.645032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.645032] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.645032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.645032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.645032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.645410] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.645410] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 is going to be updated. [ 1119.671852] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.672039] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.672039] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.672447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.672447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.681847] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 in Status: IN_PROGRESS for 2s [ 1119.763365] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.763602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.763696] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.763975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.764117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.764245] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8645530-de9a-4187-9078-4d9ec14cdb6b is going to be created. [ 1119.789631] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.790864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.790978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.791228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.791429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.793120] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.793406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.793585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.793902] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.794074] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.794245] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be updated. [ 1119.819505] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: UNINITIALIZED for 2s [ 1119.836323] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.836508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.836796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.836796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.836958] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.847230] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 1120.348768] env[65413]: INFO networking_nsxv3.common.synchronization [req-878c4afc-3783-4dc7-b45e-dfefc5b73716 req-5cdc3aba-3582-44f7-9e98-8174a8649131 tempest-ListServerFiltersTestJSON-481585564 tempest-ListServerFiltersTestJSON-481585564-project-member] Enqueued Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1120.348768] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1120.349100] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.349253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.683282] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-807 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.683446] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-807" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.683623] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-807" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.684059] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-807" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.684365] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.684542] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.684660] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.684997] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.685168] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.685380] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.685492] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1120.685598] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1120.685704] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1120.685810] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1120.685914] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1120.686057] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1120.705821] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1120.706040] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1120.706200] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1120.706403] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-807" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.706756] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-07561e7e-f890-41b9-8380-372bb893f14e taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.706961] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-07561e7e-f890-41b9-8380-372bb893f14e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.707114] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-07561e7e-f890-41b9-8380-372bb893f14e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.707485] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-07561e7e-f890-41b9-8380-372bb893f14e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.707648] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07561e7e-f890-41b9-8380-372bb893f14e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.120401] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 1121.120589] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 deletion is rescheduled due to dependency. [ 1121.120689] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.210545] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.210823] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.210908] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.211270] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.211433] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.211611] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 07561e7e-f890-41b9-8380-372bb893f14e not found, creating... [ 1121.211896] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.212186] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.212294] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.212454] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.212594] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.212942] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.213139] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.213227] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.213465] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.213648] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.213738] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 07561e7e-f890-41b9-8380-372bb893f14e is going to be created. [ 1121.234169] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.234514] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.234769] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.235230] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.235629] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.235974] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-07561e7e-f890-41b9-8380-372bb893f14e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.699698] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 in Status: SUCCESS [ 1121.700086] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8 deletion is rescheduled due to dependency. [ 1121.700086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.833024] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: SUCCESS [ 1121.833024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.833024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.833024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.833024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.833024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.833024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.833024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.833024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.833024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.833024] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.833665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.833665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.833665] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.833757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.833757] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.834735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.834735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.834735] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.858044] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 1121.858254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.858412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.858730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.858991] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.859181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.859279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.859494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.860026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.860141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.860235] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.960246] env[65413]: INFO networking_nsxv3.common.synchronization [req-878c4afc-3783-4dc7-b45e-dfefc5b73716 req-d1dbcc18-3068-4a35-ba18-213daddb632a service nova] Enqueued Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_rules [ 1121.960246] env[65413]: INFO networking_nsxv3.common.synchronization [req-878c4afc-3783-4dc7-b45e-dfefc5b73716 req-d1dbcc18-3068-4a35-ba18-213daddb632a service nova] Enqueued Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1121.960246] env[65413]: INFO networking_nsxv3.common.synchronization [req-878c4afc-3783-4dc7-b45e-dfefc5b73716 req-d1dbcc18-3068-4a35-ba18-213daddb632a service nova] Enqueued Resource ID: 07561e7e-f890-41b9-8380-372bb893f14e with Priority: HIGHEST for action port [ 1121.960246] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_rules [ 1121.960246] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1121.960246] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07561e7e-f890-41b9-8380-372bb893f14e with Priority: HIGHEST for action port [ 1121.960246] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.960246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.960246] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.960246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.960246] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-07561e7e-f890-41b9-8380-372bb893f14e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.960781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07561e7e-f890-41b9-8380-372bb893f14e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.960781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07561e7e-f890-41b9-8380-372bb893f14e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.960781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07561e7e-f890-41b9-8380-372bb893f14e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.960912] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07561e7e-f890-41b9-8380-372bb893f14e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.291384] env[65413]: INFO networking_nsxv3.common.synchronization [req-60c4a26c-7c09-4efa-afb9-60a7c704033e req-8fadcb1e-2de6-4cf4-81ee-ddb1f1d3a34b tempest-ListServerFiltersTestJSON-481585564 tempest-ListServerFiltersTestJSON-481585564-project-member] Enqueued Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1122.292119] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1122.292554] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.292699] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.336384] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.336550] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.336685] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.364349] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.364540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.364540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.364747] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.364913] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.365019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.365083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.365234] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.365318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.365402] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.365543] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.365632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.365692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.365830] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.365962] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.366064] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.366124] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.366258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.366330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.366407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.366492] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.464273] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07561e7e-f890-41b9-8380-372bb893f14e with status ACTIVE [ 1122.464440] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.464506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.464540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.464979] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.464979] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.465145] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.465237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.465237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.465459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.465561] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.465831] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.465939] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.465993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.467181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.467181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.467181] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07561e7e-f890-41b9-8380-372bb893f14e is going to be updated. [ 1122.488064] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.488216] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.488278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.488503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.488641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.488800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07561e7e-f890-41b9-8380-372bb893f14e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.598943] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-807 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.599588] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-807" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.599588] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-807" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.599588] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-807" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.600329] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.600447] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.600493] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.600696] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.600843] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.601066] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.601177] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1122.601283] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1122.601395] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1122.601521] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1122.601624] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1122.601788] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1122.624747] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1122.624917] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1122.625066] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1122.625308] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-807" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.625646] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-98856794-5b97-4a7f-8d7a-b654902c5c3b taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.625821] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-98856794-5b97-4a7f-8d7a-b654902c5c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.625942] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-98856794-5b97-4a7f-8d7a-b654902c5c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.626311] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-98856794-5b97-4a7f-8d7a-b654902c5c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.626439] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98856794-5b97-4a7f-8d7a-b654902c5c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.838616] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.868318] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for abda67a6-20b2-4d8b-8a37-701a11fb0d75: rpc.has_security_group_logging(os_id): False [ 1122.886837] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.887056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.887101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.887354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.887449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.887671] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.887770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.887832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.887989] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.888078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.888258] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.888352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.888413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.888551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.888626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.888828] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.888940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.889012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.889163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.889234] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.889318] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be updated. [ 1122.954298] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.954532] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.954532] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.954702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.954804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.982395] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 1123.129422] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.129804] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.130057] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.130513] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.130783] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.131073] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 98856794-5b97-4a7f-8d7a-b654902c5c3b not found, creating... [ 1123.131539] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.131822] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.131981] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.133421] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.133421] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.133421] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.133675] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.133939] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.134225] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.134439] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.134642] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 98856794-5b97-4a7f-8d7a-b654902c5c3b is going to be created. [ 1123.158239] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.158599] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.158765] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.159139] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.159664] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.159747] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-98856794-5b97-4a7f-8d7a-b654902c5c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.340684] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.340853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.340949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.341196] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.344247] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.344247] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8645530-de9a-4187-9078-4d9ec14cdb6b is going to be updated. [ 1123.374646] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.374863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.374863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.375205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.375424] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.386561] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: IN_PROGRESS for 2s [ 1123.858643] env[65413]: INFO networking_nsxv3.common.synchronization [req-60c4a26c-7c09-4efa-afb9-60a7c704033e req-237cba71-be55-4429-bfa6-4e579566d3cd service nova] Enqueued Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_rules [ 1123.858876] env[65413]: INFO networking_nsxv3.common.synchronization [req-60c4a26c-7c09-4efa-afb9-60a7c704033e req-237cba71-be55-4429-bfa6-4e579566d3cd service nova] Enqueued Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1123.858914] env[65413]: INFO networking_nsxv3.common.synchronization [req-60c4a26c-7c09-4efa-afb9-60a7c704033e req-237cba71-be55-4429-bfa6-4e579566d3cd service nova] Enqueued Resource ID: 98856794-5b97-4a7f-8d7a-b654902c5c3b with Priority: HIGHEST for action port [ 1123.860165] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_rules [ 1123.860165] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1123.860165] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98856794-5b97-4a7f-8d7a-b654902c5c3b with Priority: HIGHEST for action port [ 1123.860165] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.860165] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.860417] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.860476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.860666] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-98856794-5b97-4a7f-8d7a-b654902c5c3b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.860765] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98856794-5b97-4a7f-8d7a-b654902c5c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.860824] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98856794-5b97-4a7f-8d7a-b654902c5c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.861059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98856794-5b97-4a7f-8d7a-b654902c5c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.861195] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98856794-5b97-4a7f-8d7a-b654902c5c3b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.363193] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98856794-5b97-4a7f-8d7a-b654902c5c3b with status ACTIVE [ 1124.363546] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.363655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.363726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.363895] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.364107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.364242] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.364361] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.364411] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.365021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.365021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.365021] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.365021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.365021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.365246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.365246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.365246] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98856794-5b97-4a7f-8d7a-b654902c5c3b is going to be updated. [ 1124.392849] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.392849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.394087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.394087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.394768] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.394768] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98856794-5b97-4a7f-8d7a-b654902c5c3b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.662976] env[65413]: INFO networking_nsxv3.common.synchronization [req-30547ee8-3f71-47ee-ae7a-324edc907753 req-ff6c2a6e-5444-4720-9fa5-688706ca41c9 tempest-ServersTestJSON-1291473095 tempest-ServersTestJSON-1291473095-project-member] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1124.664642] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1124.664642] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.664642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.664642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.665030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.666029] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.666029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.666029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.666281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.666441] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.666571] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.003523] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 1125.004242] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.027962] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.028297] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.028529] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.028931] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.029394] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.029661] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.029883] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.030259] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.030542] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.030835] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.031053] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1125.031272] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1125.031472] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1125.031670] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.031878] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1125.032142] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1125.055037] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1125.055160] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1125.055334] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1125.055611] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.056130] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-3e937c0e-61ca-42c8-8364-e31dca915601 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.056490] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-3e937c0e-61ca-42c8-8364-e31dca915601" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.056672] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-3e937c0e-61ca-42c8-8364-e31dca915601" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.057184] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-3e937c0e-61ca-42c8-8364-e31dca915601" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.057421] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e937c0e-61ca-42c8-8364-e31dca915601',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.168533] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.398027] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: SUCCESS [ 1125.398027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.398027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.398239] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.398239] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.398356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.398416] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.398695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.398695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.398756] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.560353] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.560599] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.560749] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.561039] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.561216] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.561417] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 3e937c0e-61ca-42c8-8364-e31dca915601 not found, creating... [ 1125.561691] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.561851] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.561970] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.562212] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.562347] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.562624] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.562777] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.562890] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.563134] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.563269] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.563403] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 3e937c0e-61ca-42c8-8364-e31dca915601 is going to be created. [ 1125.582212] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.582411] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.582536] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.582779] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.583024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.583242] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-3e937c0e-61ca-42c8-8364-e31dca915601" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.670370] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.907474] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.175698] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.175698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.175698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.175698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.175698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.175698] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1126.216041] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.216041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.216041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.216041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.216041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.229658] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1126.329484] env[65413]: INFO networking_nsxv3.common.synchronization [req-30547ee8-3f71-47ee-ae7a-324edc907753 req-d631a47d-415d-4d73-a34a-0d0db6cd6d89 service nova] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_rules [ 1126.329791] env[65413]: INFO networking_nsxv3.common.synchronization [req-30547ee8-3f71-47ee-ae7a-324edc907753 req-d631a47d-415d-4d73-a34a-0d0db6cd6d89 service nova] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1126.329911] env[65413]: INFO networking_nsxv3.common.synchronization [req-30547ee8-3f71-47ee-ae7a-324edc907753 req-d631a47d-415d-4d73-a34a-0d0db6cd6d89 service nova] Enqueued Resource ID: 3e937c0e-61ca-42c8-8364-e31dca915601 with Priority: HIGHEST for action port [ 1126.331810] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_rules [ 1126.331913] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1126.331993] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e937c0e-61ca-42c8-8364-e31dca915601 with Priority: HIGHEST for action port [ 1126.332358] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.332648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.332648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.333079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.333216] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.335341] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.335341] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.335611] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e937c0e-61ca-42c8-8364-e31dca915601 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.335611] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e937c0e-61ca-42c8-8364-e31dca915601" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.335611] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e937c0e-61ca-42c8-8364-e31dca915601" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.335755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e937c0e-61ca-42c8-8364-e31dca915601" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.335850] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e937c0e-61ca-42c8-8364-e31dca915601',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.409924] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.839428] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.839548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.839823] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e937c0e-61ca-42c8-8364-e31dca915601 with status ACTIVE [ 1126.839936] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.840012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.840075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.840284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.840371] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.840540] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.840683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.840747] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.840933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.841123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.841320] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.841417] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.841478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.841622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.841696] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.841781] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e937c0e-61ca-42c8-8364-e31dca915601 is going to be updated. [ 1126.866052] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.866217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.866338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.866573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.866822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.866913] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e937c0e-61ca-42c8-8364-e31dca915601" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.915009] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.915276] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.915364] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.915613] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.915701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.915814] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8645530-de9a-4187-9078-4d9ec14cdb6b is going to be updated. [ 1126.958637] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.958828] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.958900] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.959175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.959345] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.970509] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: IN_PROGRESS for 2s [ 1127.046313] env[65413]: INFO networking_nsxv3.common.synchronization [req-1a3328ee-4679-4e2d-8439-dfc15fba88c9 req-9cb0f927-d736-4a44-afd4-4f55e6f1f2c0 tempest-ServerDiskConfigTestJSON-938124936 tempest-ServerDiskConfigTestJSON-938124936-project-member] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1127.046826] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1127.047154] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.047301] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.047352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.047604] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.047689] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.048317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.048386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.048560] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.048642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.048737] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.282819] env[65413]: INFO networking_nsxv3.common.synchronization [req-a73ad028-e1d7-4f17-8383-820aac8b8bec req-58f76066-efea-40af-97f3-517b61c405cd tempest-AttachVolumeTestJSON-893762802 tempest-AttachVolumeTestJSON-893762802-project-member] Enqueued Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGHEST for action security_group_members [ 1127.283451] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGHEST for action security_group_members [ 1127.283792] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-edbcf595-e502-4812-b097-93b4e6d1355d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.283923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.284047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.284275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.284953] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.284953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.284953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.284953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.284953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.284953] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('edbcf595-e502-4812-b097-93b4e6d1355d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.431452] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-302 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.431661] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.431781] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.432906] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.432906] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.432906] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.432906] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.432906] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.432906] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.433229] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1127.433329] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1127.433427] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1127.433534] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1127.433644] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1127.433749] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1127.433895] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1127.453916] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1127.454181] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1127.454330] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1127.454556] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-302" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.454908] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-6050f903-ba01-40ee-8b65-cfd0699ed40b taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.455099] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-6050f903-ba01-40ee-8b65-cfd0699ed40b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.455219] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-6050f903-ba01-40ee-8b65-cfd0699ed40b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.455557] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-6050f903-ba01-40ee-8b65-cfd0699ed40b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.455697] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6050f903-ba01-40ee-8b65-cfd0699ed40b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.553020] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.553020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.553020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.553020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.553020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.553020] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.553020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.553020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.553020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.553020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.553020] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 1127.589308] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.589308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.589308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.589308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.589308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.598340] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 1127.789446] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.789620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.789751] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.789866] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.789959] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.790164] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.790261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.790314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.790468] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.790543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.790628] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edbcf595-e502-4812-b097-93b4e6d1355d is going to be updated. [ 1127.820973] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.821159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.821201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.821412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.821596] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.830985] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edbcf595-e502-4812-b097-93b4e6d1355d in Status: IN_PROGRESS for 2s [ 1127.957642] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.957902] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.958040] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.958364] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.958534] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.958712] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 6050f903-ba01-40ee-8b65-cfd0699ed40b not found, creating... [ 1127.959207] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.959307] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.959369] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.959607] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.959745] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.960074] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.960252] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.960392] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.960623] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.960758] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.960964] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 6050f903-ba01-40ee-8b65-cfd0699ed40b is going to be created. [ 1127.986368] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.986562] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.986705] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.986983] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.987294] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.987533] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-6050f903-ba01-40ee-8b65-cfd0699ed40b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.242402] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 4s [ 1128.708009] env[65413]: INFO networking_nsxv3.common.synchronization [req-1a3328ee-4679-4e2d-8439-dfc15fba88c9 req-989bb825-fd1a-4e89-809b-3c1051b46ea6 service nova] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_rules [ 1128.708282] env[65413]: INFO networking_nsxv3.common.synchronization [req-1a3328ee-4679-4e2d-8439-dfc15fba88c9 req-989bb825-fd1a-4e89-809b-3c1051b46ea6 service nova] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1128.708369] env[65413]: INFO networking_nsxv3.common.synchronization [req-1a3328ee-4679-4e2d-8439-dfc15fba88c9 req-989bb825-fd1a-4e89-809b-3c1051b46ea6 service nova] Enqueued Resource ID: 6050f903-ba01-40ee-8b65-cfd0699ed40b with Priority: HIGHEST for action port [ 1128.708986] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_rules [ 1128.709175] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1128.709277] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6050f903-ba01-40ee-8b65-cfd0699ed40b with Priority: HIGHEST for action port [ 1128.709668] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.709751] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.709871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.710138] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.710250] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.711424] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.711424] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.711760] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-6050f903-ba01-40ee-8b65-cfd0699ed40b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.711760] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6050f903-ba01-40ee-8b65-cfd0699ed40b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.711760] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6050f903-ba01-40ee-8b65-cfd0699ed40b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.712080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6050f903-ba01-40ee-8b65-cfd0699ed40b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.712080] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6050f903-ba01-40ee-8b65-cfd0699ed40b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.981568] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: SUCCESS [ 1128.981568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.981844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.981899] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.982058] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.982189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.982248] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.982414] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.982494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.982591] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.214816] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.215232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.215719] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6050f903-ba01-40ee-8b65-cfd0699ed40b with status ACTIVE [ 1129.216381] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.216381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.216381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.216751] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.217015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.217522] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.217522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.217522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.217746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.217891] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.218867] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.218975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.219065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.219268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.219362] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.219553] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6050f903-ba01-40ee-8b65-cfd0699ed40b is going to be updated. [ 1129.330746] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.331100] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.331174] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.331457] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.331537] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.331654] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6050f903-ba01-40ee-8b65-cfd0699ed40b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.485609] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.611508] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 1129.611508] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 deletion is rescheduled due to dependency. [ 1129.611508] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.611749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.611864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.612042] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.612158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.612221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.613273] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.613273] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.613273] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.844060] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: edbcf595-e502-4812-b097-93b4e6d1355d in Status: SUCCESS [ 1129.844060] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: edbcf595-e502-4812-b097-93b4e6d1355d deletion is rescheduled due to dependency. [ 1129.844557] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.988042] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.115266] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.254526] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1130.254753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.254933] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.255240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.255455] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.255578] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.255639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.255967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.255967] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.256064] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.491377] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.491587] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.491587] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.491820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.491910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.492017] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8645530-de9a-4187-9078-4d9ec14cdb6b is going to be updated. [ 1130.528903] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.529132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.529132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.529386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.529574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.544132] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: IN_PROGRESS for 2s [ 1130.617805] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.631977] env[65413]: INFO networking_nsxv3.common.synchronization [req-3feedcfc-105a-4307-a190-aa92ada93be9 req-42932a5f-ec4d-4994-b20e-d3b8c84ebd37 tempest-ServerActionsTestOtherA-276981019 tempest-ServerActionsTestOtherA-276981019-project-member] Enqueued Resource ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 with Priority: HIGHEST for action security_group_members [ 1130.632997] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 with Priority: HIGHEST for action security_group_members [ 1130.633379] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.633943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.633943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.633943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.634186] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.634310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.634310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.634486] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.634586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.634714] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.758930] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.121077] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.121489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.121489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.121600] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.121695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.121798] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 1131.138338] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.138594] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.138718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.139073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.153521] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.154506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.154506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.154506] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.154667] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.163756] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 1131.168082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.168363] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.168478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.168546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.169023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.169023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.169023] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 is going to be updated. [ 1131.200866] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.201110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.201191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.201413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.201554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.218554] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 in Status: IN_PROGRESS for 2s [ 1131.262289] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.765065] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.765249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.765328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.765695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.765791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.765892] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1131.797296] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.797502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.797660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.797903] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.798083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.807594] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1132.567979] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: SUCCESS [ 1132.568403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.568403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.568625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.568844] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.568963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.569044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.569375] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.569461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.569548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.569729] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.569813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.569872] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.570043] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.570169] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.570268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.570328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.570464] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.570537] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.570616] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.570697] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.571691] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.571908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.572124] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.572452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.572610] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.572745] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.572874] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.573067] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.076445] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.077745] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8645530-de9a-4187-9078-4d9ec14cdb6b: rpc.has_security_group_logging(os_id): False [ 1133.099252] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.099587] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.099587] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.099917] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.100031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.100275] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.100392] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.100456] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.100631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.100713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.100995] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.101147] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.101220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.101398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.101469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.101678] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.101786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.101852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.102018] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.102095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.102222] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8645530-de9a-4187-9078-4d9ec14cdb6b is going to be created. [ 1133.181119] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 1133.181422] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.181656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.182604] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.182604] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.182604] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.182604] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.182850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.182850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.182850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.182929] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.232881] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.233287] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.233351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.233670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.233955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.237035] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 in Status: SUCCESS [ 1133.237281] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4 deletion is rescheduled due to dependency. [ 1133.237511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.253922] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: IN_PROGRESS for 2s [ 1133.580164] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.685804] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.686075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.686075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.686296] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.686474] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.686580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.686643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.686793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.686879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.686965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.687128] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.687223] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.687283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.687425] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.687560] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.687652] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.687712] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.687848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.687923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.688009] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.688105] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.817750] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1133.817954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.818220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.818455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.818656] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.818778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.818836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.818997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.819086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.819176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.819249] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.082818] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.083047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.083158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.083335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.083427] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.083525] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8645530-de9a-4187-9078-4d9ec14cdb6b is going to be updated. [ 1134.120045] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.120045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.120045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.120045] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.120343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.130244] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: IN_PROGRESS for 2s [ 1134.191050] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 579e1066-bea4-4954-a499-fb0ae75b5375: rpc.has_security_group_logging(os_id): False [ 1134.216159] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.216396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.216396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.216608] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.216707] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.216937] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.217075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.217175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.217303] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.217382] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.217584] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.217683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.217991] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.217991] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.217991] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.218236] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.218350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.218403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.218554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.218702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.218702] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 1134.291075] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.291164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.291216] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.291688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.291880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.322046] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.322265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.322265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.322631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.323100] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.323244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.323325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.323534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.323629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.323713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.323892] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.323983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.324087] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.324464] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.324464] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.324604] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.324696] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.324835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.324935] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.325023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.325118] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.326861] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 1134.830615] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c4cbecb-5529-4a33-ade6-6d4e0203047a: rpc.has_security_group_logging(os_id): False [ 1134.849748] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.849864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.849937] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.850167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.850277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.850799] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.850799] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.850799] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.850992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.851031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.851229] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.851318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.851383] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.851524] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.851595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.851806] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.851921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.851961] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.852103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.852171] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.852252] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1134.915584] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.915584] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.915584] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.915809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.916240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.933815] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1135.002311] env[65413]: INFO networking_nsxv3.common.synchronization [req-3e5f4d27-e546-434f-8a9e-6c1284084145 req-236e0292-be6c-4165-8b98-4269ad5f8f85 tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_members [ 1135.003426] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_members [ 1135.003426] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.003426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.003426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.003696] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.003816] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.003914] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.003990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.004180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.004299] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.004390] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.273143] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: SUCCESS [ 1135.273143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.273143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.273143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.273143] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.507741] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.775498] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.775498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.798750] env[65413]: INFO networking_nsxv3.common.synchronization [None req-bb26af3c-b222-4cc9-bc2d-4059d992a146 tempest-AttachVolumeTestJSON-893762802 tempest-AttachVolumeTestJSON-893762802-project-member] Enqueued Resource ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea with Priority: HIGHEST for action security_group_rules [ 1135.799308] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea with Priority: HIGHEST for action security_group_rules [ 1135.799803] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7af49b3e-c32d-4c08-b110-379fb74e2bea taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.799925] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.800212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.800275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.800339] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7af49b3e-c32d-4c08-b110-379fb74e2bea',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.924366] env[65413]: INFO networking_nsxv3.common.synchronization [None req-9700e92d-c26b-4526-8964-7dd5fb5133c1 tempest-AttachVolumeTestJSON-893762802 tempest-AttachVolumeTestJSON-893762802-project-member] Enqueued Resource ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea with Priority: HIGHEST for action security_group_rules [ 1135.924366] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea with Priority: HIGHEST for action security_group_rules [ 1135.924366] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7af49b3e-c32d-4c08-b110-379fb74e2bea taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.924366] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.010288] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.141940] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: SUCCESS [ 1136.141940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.142182] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.142451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.142724] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.142913] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.143061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.143292] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.143386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.144033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.144033] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.321045] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.321208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.321585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.321585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.321767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.321767] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea already deleted. [ 1136.321856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.322023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.322236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.322348] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7af49b3e-c32d-4c08-b110-379fb74e2bea',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.347964] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 1136.348371] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.513570] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.513570] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.513570] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.514555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.514555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.514555] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a is going to be updated. [ 1136.563761] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.564065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.564065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.564198] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.564346] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.573626] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a in Status: IN_PROGRESS for 2s [ 1136.647011] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.647011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.647011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.647011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.647011] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.647011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.647011] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.647356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.647356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.647356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.648233] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.648233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.648233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.648233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.648233] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.648233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.648233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.648526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.648526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.648526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.648526] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.849042] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.849253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.849327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.849570] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.849657] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.849752] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea already deleted. [ 1136.849832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.954103] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1136.954398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.150686] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8645530-de9a-4187-9078-4d9ec14cdb6b: rpc.has_security_group_logging(os_id): False [ 1137.170238] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.170451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.170451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.170852] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.171049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.171300] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.171430] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.171496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.171703] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.171809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.172054] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.172179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.172245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.172398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.172472] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.172681] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.172885] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.172885] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.172969] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.173020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.173163] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8645530-de9a-4187-9078-4d9ec14cdb6b is going to be updated. [ 1137.241191] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.241341] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.241413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.241635] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.241791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.260239] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: IN_PROGRESS for 2s [ 1137.765968] env[65413]: INFO networking_nsxv3.common.synchronization [req-0808ac30-11b2-40a9-b858-ade1d4890acc req-4c7dcb46-3843-41b6-8d43-ac9627ee84aa tempest-ServerActionsTestJSON-1087044681 tempest-ServerActionsTestJSON-1087044681-project-member] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 1137.766625] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 1137.767076] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.767268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.767352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.767633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.767863] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.768291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.768291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.768442] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.768442] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.768565] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.141228] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-56 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.141636] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.141891] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.142275] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.142589] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.142786] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.142905] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.143301] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.143402] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.143614] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.143726] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1138.143832] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1138.143937] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1138.144208] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1138.144374] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1138.144522] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1138.165434] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1138.165695] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1138.165871] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1138.166061] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-56" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.166383] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-d39bf165-1107-4e53-8cf7-dfd6cb0f76a7 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.166602] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-d39bf165-1107-4e53-8cf7-dfd6cb0f76a7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.166662] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-d39bf165-1107-4e53-8cf7-dfd6cb0f76a7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.167008] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-d39bf165-1107-4e53-8cf7-dfd6cb0f76a7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.167151] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d39bf165-1107-4e53-8cf7-dfd6cb0f76a7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.273266] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.274031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.274031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.274031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.274253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.274303] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.274386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.274452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.274615] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.274696] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.274778] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef is going to be updated. [ 1138.300917] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.301199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.301291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.301542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.301700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.327731] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: IN_PROGRESS for 2s [ 1138.584429] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a in Status: SUCCESS [ 1138.584653] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.670654] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.671062] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.671293] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.671737] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.671983] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.672246] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port d39bf165-1107-4e53-8cf7-dfd6cb0f76a7 not found, creating... [ 1138.672698] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.672960] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.673299] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.673658] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.674411] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.674411] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.674620] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.674840] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.675199] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.675417] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.676229] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: d39bf165-1107-4e53-8cf7-dfd6cb0f76a7 is going to be created. [ 1138.698571] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.698943] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.699186] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.699826] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.700241] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.700572] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-d39bf165-1107-4e53-8cf7-dfd6cb0f76a7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.277379] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: SUCCESS [ 1139.277718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.277846] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.278059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.278387] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.453848] env[65413]: INFO networking_nsxv3.common.synchronization [req-0808ac30-11b2-40a9-b858-ade1d4890acc req-575adc1c-ea81-4d7e-a00b-0314838370a3 service nova] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_rules [ 1139.454062] env[65413]: INFO networking_nsxv3.common.synchronization [req-0808ac30-11b2-40a9-b858-ade1d4890acc req-575adc1c-ea81-4d7e-a00b-0314838370a3 service nova] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 1139.454265] env[65413]: INFO networking_nsxv3.common.synchronization [req-0808ac30-11b2-40a9-b858-ade1d4890acc req-575adc1c-ea81-4d7e-a00b-0314838370a3 service nova] Enqueued Resource ID: d39bf165-1107-4e53-8cf7-dfd6cb0f76a7 with Priority: HIGHEST for action port [ 1139.454972] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_rules [ 1139.455164] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 1139.455412] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d39bf165-1107-4e53-8cf7-dfd6cb0f76a7 with Priority: HIGHEST for action port [ 1139.455677] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.455847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.455943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.456246] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.456489] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.457387] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.457673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.457879] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-d39bf165-1107-4e53-8cf7-dfd6cb0f76a7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.458056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d39bf165-1107-4e53-8cf7-dfd6cb0f76a7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.458167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d39bf165-1107-4e53-8cf7-dfd6cb0f76a7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.458361] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d39bf165-1107-4e53-8cf7-dfd6cb0f76a7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.458439] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d39bf165-1107-4e53-8cf7-dfd6cb0f76a7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.781139] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.781139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.781139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.781139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.781333] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.781333] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.781333] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.781486] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.781573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.781659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.781744] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.959788] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.959940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.960184] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d39bf165-1107-4e53-8cf7-dfd6cb0f76a7 with status ACTIVE [ 1139.960401] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.960551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.960632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.960876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.961079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.961309] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.961415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.961522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.962157] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.962157] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.962157] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.962491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.962491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.962491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.962585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.962776] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d39bf165-1107-4e53-8cf7-dfd6cb0f76a7 is going to be updated. [ 1139.985187] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.985350] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.985431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.985672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.985810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.985986] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d39bf165-1107-4e53-8cf7-dfd6cb0f76a7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.286639] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.286946] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.287821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.288201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.288472] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.288680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.288762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.289044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.289176] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.289336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.289565] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.289675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.289735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.289997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.294258] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.294681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.294681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.294849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.294910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.295477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.295477] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.341569] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: SUCCESS [ 1140.341569] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef deletion is rescheduled due to dependency. [ 1140.341569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.341569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.341569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.341569] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.341569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.341569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.341569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.341569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.344792] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.803191] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d8645530-de9a-4187-9078-4d9ec14cdb6b: rpc.has_security_group_logging(os_id): False [ 1140.823254] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.823254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.823254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.823254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.823254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.823254] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.823254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.823254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.823254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.823254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.823254] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.823254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.823254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.823254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.823254] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.823741] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.823741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.823741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.823741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.823741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.823899] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d8645530-de9a-4187-9078-4d9ec14cdb6b is going to be updated. [ 1140.848847] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.897139] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.897139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.897139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.897139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.897139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.930122] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: IN_PROGRESS for 2s [ 1141.351842] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.856434] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.856608] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.856682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.856909] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.856997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.857110] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef is going to be updated. [ 1141.894533] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.894640] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.894706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.894942] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.895115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.905317] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: IN_PROGRESS for 2s [ 1142.278463] env[65413]: INFO networking_nsxv3.common.synchronization [req-81894b70-92e9-42d8-b838-ce594cfdcf8a req-273ba049-d149-4b13-a83b-1180bb321e59 tempest-ServerDiskConfigTestJSON-938124936 tempest-ServerDiskConfigTestJSON-938124936-project-member] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1142.279031] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGHEST for action security_group_members [ 1142.279412] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.279585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.279585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.279843] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.279953] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.280080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.280148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.280298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.280474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.280607] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.783707] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.784105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.784105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.784277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.784310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.784520] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.784626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.784687] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.784978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.784978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.784978] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be updated. [ 1142.820011] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.820213] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.820332] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.820563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.820710] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.838264] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: IN_PROGRESS for 2s [ 1142.950491] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: SUCCESS [ 1142.950730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.918934] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: SUCCESS [ 1143.919453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.919453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.919622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.919829] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.920014] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.920141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.920351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.920438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.920528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.920622] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.423495] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.474259] env[65413]: INFO networking_nsxv3.common.synchronization [req-011b9bbc-05f2-449e-a89e-cf6ad29c0c1c req-8b317c18-1e83-4acf-b59c-03f83e34c1e3 tempest-ServersTestJSON-1291473095 tempest-ServersTestJSON-1291473095-project-member] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1144.474259] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1144.474259] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.474488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.474488] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.474730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.474730] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.474818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.474869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.475155] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.475155] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.475240] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.780753] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.781010] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.781180] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.781471] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.781797] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.781920] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.782045] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.782299] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.782452] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.782655] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1144.782767] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1144.782873] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1144.782976] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1144.783113] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1144.783276] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1144.783357] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1144.806534] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1144.806918] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1144.807206] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1144.808212] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.808212] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-1f61c7b8-4e8c-4285-aaea-c6829ed49880 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.808212] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-1f61c7b8-4e8c-4285-aaea-c6829ed49880" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.808421] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-1f61c7b8-4e8c-4285-aaea-c6829ed49880" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.809279] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-1f61c7b8-4e8c-4285-aaea-c6829ed49880" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.809279] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f61c7b8-4e8c-4285-aaea-c6829ed49880',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.849181] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 579e1066-bea4-4954-a499-fb0ae75b5375 in Status: SUCCESS [ 1144.849181] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 deletion is rescheduled due to dependency. [ 1144.849181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.925997] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d31c425c-609d-448d-bad8-0a938d0bf8ef: rpc.has_security_group_logging(os_id): False [ 1144.944919] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.945205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.945289] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.945705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.945890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.946212] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.946344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.946405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.946536] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.946633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.946714] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef is going to be updated. [ 1144.977607] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.016383] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.016612] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.016612] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.016828] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.016984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.035350] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: IN_PROGRESS for 2s [ 1145.113904] env[65413]: INFO networking_nsxv3.common.synchronization [req-8a90770c-0e3c-41d9-a1f8-3620efad3bb9 req-b65f30e8-afb7-4d0d-ae09-89b13ff3b7f6 tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_members [ 1145.114639] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGHEST for action security_group_members [ 1145.115040] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.115202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.115295] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.115525] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.115689] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.115842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.115923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.116150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.116277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.116380] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.311157] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.311435] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.311562] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.311858] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.311998] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.312166] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 1f61c7b8-4e8c-4285-aaea-c6829ed49880 not found, creating... [ 1145.312437] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.312620] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.312705] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.312924] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.313093] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.313375] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.313528] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.313643] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.313848] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.313977] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.314145] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 1f61c7b8-4e8c-4285-aaea-c6829ed49880 is going to be created. [ 1145.336208] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.336447] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.336599] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.336947] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.337205] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.337462] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-1f61c7b8-4e8c-4285-aaea-c6829ed49880" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.480253] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.619754] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.619908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.619982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.620239] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.620338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.620540] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.620641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.620725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.620858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.620926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.621025] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a is going to be updated. [ 1145.650556] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.650718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.650755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.651036] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.651312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.660742] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a in Status: IN_PROGRESS for 2s [ 1145.983595] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.983911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.983911] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.984117] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.984765] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.984765] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1146.013760] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.014197] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.014363] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.014647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.014873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.025127] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1146.037019] env[65413]: INFO networking_nsxv3.common.synchronization [req-011b9bbc-05f2-449e-a89e-cf6ad29c0c1c req-58e3c1ae-3947-458c-854e-2d0ebb8895ae service nova] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_rules [ 1146.037176] env[65413]: INFO networking_nsxv3.common.synchronization [req-011b9bbc-05f2-449e-a89e-cf6ad29c0c1c req-58e3c1ae-3947-458c-854e-2d0ebb8895ae service nova] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1146.037656] env[65413]: INFO networking_nsxv3.common.synchronization [req-011b9bbc-05f2-449e-a89e-cf6ad29c0c1c req-58e3c1ae-3947-458c-854e-2d0ebb8895ae service nova] Enqueued Resource ID: 1f61c7b8-4e8c-4285-aaea-c6829ed49880 with Priority: HIGHEST for action port [ 1146.037858] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_rules [ 1146.037934] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1146.038040] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f61c7b8-4e8c-4285-aaea-c6829ed49880 with Priority: HIGHEST for action port [ 1146.038344] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.038446] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.038494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.038683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.038743] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.039965] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.041558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.041558] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f61c7b8-4e8c-4285-aaea-c6829ed49880 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.041558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f61c7b8-4e8c-4285-aaea-c6829ed49880" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.041558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f61c7b8-4e8c-4285-aaea-c6829ed49880" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.041558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f61c7b8-4e8c-4285-aaea-c6829ed49880" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.041558] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f61c7b8-4e8c-4285-aaea-c6829ed49880',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.542847] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.542986] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.543292] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f61c7b8-4e8c-4285-aaea-c6829ed49880 with status ACTIVE [ 1146.543464] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.543576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.543641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.543847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.544175] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.544437] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.544551] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.544617] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.544811] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.544898] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.545105] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.545204] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.545266] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.545448] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.545549] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.546216] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f61c7b8-4e8c-4285-aaea-c6829ed49880 is going to be updated. [ 1146.573619] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.573821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.573821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.573978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.574221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.574436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f61c7b8-4e8c-4285-aaea-c6829ed49880" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.810427] env[65413]: INFO networking_nsxv3.common.synchronization [req-51ad249f-13c8-4ecf-b618-a0e0e1a8c603 req-d9cf64ed-cb6f-4389-b32f-d7e4b3a4e35d tempest-AttachVolumeTestJSON-893762802 tempest-AttachVolumeTestJSON-893762802-project-member] Enqueued Resource ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea with Priority: HIGHEST for action security_group_members [ 1146.811045] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea with Priority: HIGHEST for action security_group_members [ 1146.811402] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7af49b3e-c32d-4c08-b110-379fb74e2bea taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.811543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.811619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.811955] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.812329] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.812496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.812604] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.812817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.812907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.813007] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7af49b3e-c32d-4c08-b110-379fb74e2bea',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.054364] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: SUCCESS [ 1147.054718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.121070] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-367 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.121290] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-367" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.121418] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-367" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.121826] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-367" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.121945] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.122126] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.122241] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.122451] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.122596] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.122804] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.122916] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1147.123034] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1147.123200] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1147.123339] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1147.123452] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1147.123597] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1147.144623] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1147.144884] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1147.144999] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1147.145219] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-367" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.145590] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-0ecb5389-731a-440b-a943-a5c0557be6f9 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.145796] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-0ecb5389-731a-440b-a943-a5c0557be6f9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.145938] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-0ecb5389-731a-440b-a943-a5c0557be6f9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.146329] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-0ecb5389-731a-440b-a943-a5c0557be6f9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.146552] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ecb5389-731a-440b-a943-a5c0557be6f9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.315193] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.315377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.315427] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.315645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.315738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.315937] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.316050] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.316115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.316269] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.316344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.316428] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea already deleted. [ 1147.316507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.649279] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.649601] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.649754] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.650100] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.650257] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.650401] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 0ecb5389-731a-440b-a943-a5c0557be6f9 not found, creating... [ 1147.650675] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.652148] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.652148] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.652148] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.652148] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.652148] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.652148] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.652148] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.652148] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.652397] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.652397] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 0ecb5389-731a-440b-a943-a5c0557be6f9 is going to be created. [ 1147.670178] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a in Status: SUCCESS [ 1147.670178] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a deletion is rescheduled due to dependency. [ 1147.670318] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.681122] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.681315] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.681362] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.681650] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.681895] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.682149] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-0ecb5389-731a-440b-a943-a5c0557be6f9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.036969] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1148.037240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.037461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.037740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.037977] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.038126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.038192] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.038340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.038421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.038507] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.276844] env[65413]: INFO networking_nsxv3.common.synchronization [req-ab83d69a-e49e-4d88-b49b-e4f962a0bd32 req-1a4f7f3e-aaf0-42cb-9e65-f4ffb02584a9 tempest-ServerActionsTestOtherB-69504015 tempest-ServerActionsTestOtherB-69504015-project-member] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1148.276844] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1148.277266] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.277343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.277343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.277562] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.277695] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.277799] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.277857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.278013] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.280403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.280403] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.409169] env[65413]: INFO networking_nsxv3.common.synchronization [req-51ad249f-13c8-4ecf-b618-a0e0e1a8c603 req-61b67ffb-4779-43b0-b045-ed004816b27c service nova] Enqueued Resource ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea with Priority: HIGHEST for action security_group_rules [ 1148.409169] env[65413]: INFO networking_nsxv3.common.synchronization [req-51ad249f-13c8-4ecf-b618-a0e0e1a8c603 req-61b67ffb-4779-43b0-b045-ed004816b27c service nova] Enqueued Resource ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea with Priority: HIGHEST for action security_group_members [ 1148.409169] env[65413]: INFO networking_nsxv3.common.synchronization [req-51ad249f-13c8-4ecf-b618-a0e0e1a8c603 req-61b67ffb-4779-43b0-b045-ed004816b27c service nova] Enqueued Resource ID: 0ecb5389-731a-440b-a943-a5c0557be6f9 with Priority: HIGHEST for action port [ 1148.409169] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea with Priority: HIGHEST for action security_group_rules [ 1148.411021] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea with Priority: HIGHEST for action security_group_members [ 1148.416948] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ecb5389-731a-440b-a943-a5c0557be6f9 with Priority: HIGHEST for action port [ 1148.418037] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7af49b3e-c32d-4c08-b110-379fb74e2bea taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.418037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.418037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.418298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.418298] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7af49b3e-c32d-4c08-b110-379fb74e2bea',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.421726] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7af49b3e-c32d-4c08-b110-379fb74e2bea taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.421726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.421726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.421726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.421726] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.421726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.422042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.422042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.422101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.422604] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7af49b3e-c32d-4c08-b110-379fb74e2bea',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.424393] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ecb5389-731a-440b-a943-a5c0557be6f9 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.424618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ecb5389-731a-440b-a943-a5c0557be6f9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.424739] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ecb5389-731a-440b-a943-a5c0557be6f9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.425044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ecb5389-731a-440b-a943-a5c0557be6f9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.425044] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ecb5389-731a-440b-a943-a5c0557be6f9',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.542912] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.699712] env[65413]: INFO networking_nsxv3.common.synchronization [req-bd00fa2b-81f0-4a45-81b5-6deab45255ab req-417f3527-682e-4fd7-b3e8-4dc1bcccb6fe tempest-ListServerFiltersTestJSON-481585564 tempest-ListServerFiltersTestJSON-481585564-project-member] Enqueued Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1148.700317] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1148.700556] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.700682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.700745] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.700965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.701567] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.701681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.701744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.701910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.701997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.702138] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.784749] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.784749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.784749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.784749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.816665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.816665] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.816665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.816665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.816665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.816665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.816665] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded is going to be updated. [ 1148.845737] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.845737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.846048] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.846224] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.846478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.856384] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: IN_PROGRESS for 2s [ 1148.931242] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ecb5389-731a-440b-a943-a5c0557be6f9 with status ACTIVE [ 1148.931397] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.931535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.931701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.933243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.933243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.933243] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.933243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.933243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.933243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.933243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.933243] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.933243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.933243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.933243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.933243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.933243] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ecb5389-731a-440b-a943-a5c0557be6f9 is going to be updated. [ 1148.935013] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7af49b3e-c32d-4c08-b110-379fb74e2bea taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.935162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.935328] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7af49b3e-c32d-4c08-b110-379fb74e2bea',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.967792] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.967887] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.967956] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.968208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.968347] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.968501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ecb5389-731a-440b-a943-a5c0557be6f9" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.042822] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.116644] env[65413]: INFO networking_nsxv3.common.synchronization [req-21c0d190-a705-4151-b05f-ea63359587c6 req-50d86b38-d5de-48c2-8ac5-94a6d47882ec tempest-ServerActionsTestOtherA-276981019 tempest-ServerActionsTestOtherA-276981019-project-member] Enqueued Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_members [ 1149.116644] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_members [ 1149.116820] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e429593-1cb3-44b2-8d70-77fbe7afbed5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.116954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.117035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.117261] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.117466] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.117570] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.118200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.118200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.118200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.118200] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.205280] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.438168] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7af49b3e-c32d-4c08-b110-379fb74e2bea',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.468311] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-598 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.468511] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.468634] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.468905] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.469174] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.469330] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.469443] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.469678] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.469800] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.470082] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1149.470210] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1149.470319] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1149.470428] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1149.470535] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1149.470649] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1149.470781] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1149.490592] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1149.490745] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1149.490882] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1149.491068] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.491375] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-0d46f6f3-a453-4374-8140-1d1a6860496d taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.491546] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-0d46f6f3-a453-4374-8140-1d1a6860496d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.491662] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-0d46f6f3-a453-4374-8140-1d1a6860496d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.492010] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-0d46f6f3-a453-4374-8140-1d1a6860496d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.492154] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d46f6f3-a453-4374-8140-1d1a6860496d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.545398] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.545570] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.545641] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.545963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.545963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.546179] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1149.574860] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.575012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.575150] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.575377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.575590] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.584594] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1149.619696] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.619865] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.619923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.620184] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.643172] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.643437] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.643574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.643633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.643816] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.643893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.643981] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 is going to be updated. [ 1149.677230] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.677418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.677487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.677648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.677783] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.698028] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 in Status: IN_PROGRESS for 2s [ 1149.707382] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.940678] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.940842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.940907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.941178] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.941258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.941361] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea is going to be created. [ 1149.970217] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.970409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.970409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.970589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.970744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.981629] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea in Status: UNINITIALIZED for 2s [ 1149.995663] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.995898] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.996232] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.996308] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.996453] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.996602] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 0d46f6f3-a453-4374-8140-1d1a6860496d not found, creating... [ 1149.996854] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.997439] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.997439] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1149.997439] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1149.997606] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.997731] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1149.997883] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1149.997990] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.002476] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.002520] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.002652] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 0d46f6f3-a453-4374-8140-1d1a6860496d is going to be created. [ 1150.025463] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.025561] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.025696] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.025971] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.026211] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.026427] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-0d46f6f3-a453-4374-8140-1d1a6860496d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.210401] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.210590] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.210693] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.210999] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.211166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.211314] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8645530-de9a-4187-9078-4d9ec14cdb6b is going to be updated. [ 1150.254066] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.254255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.254317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.254576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.254673] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.267387] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: IN_PROGRESS for 2s [ 1150.749728] env[65413]: INFO networking_nsxv3.common.synchronization [req-21c0d190-a705-4151-b05f-ea63359587c6 req-315fdc29-324d-4f20-8196-645d22ef09a7 service nova] Enqueued Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_rules [ 1150.750088] env[65413]: INFO networking_nsxv3.common.synchronization [req-21c0d190-a705-4151-b05f-ea63359587c6 req-315fdc29-324d-4f20-8196-645d22ef09a7 service nova] Enqueued Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_members [ 1150.750266] env[65413]: INFO networking_nsxv3.common.synchronization [req-21c0d190-a705-4151-b05f-ea63359587c6 req-315fdc29-324d-4f20-8196-645d22ef09a7 service nova] Enqueued Resource ID: 0d46f6f3-a453-4374-8140-1d1a6860496d with Priority: HIGHEST for action port [ 1150.750860] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_rules [ 1150.751016] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_members [ 1150.752326] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d46f6f3-a453-4374-8140-1d1a6860496d with Priority: HIGHEST for action port [ 1150.755034] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e429593-1cb3-44b2-8d70-77fbe7afbed5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.755034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.755034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.755034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.755034] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.755034] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e429593-1cb3-44b2-8d70-77fbe7afbed5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.755556] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.755556] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d46f6f3-a453-4374-8140-1d1a6860496d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.755710] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d46f6f3-a453-4374-8140-1d1a6860496d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.755752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d46f6f3-a453-4374-8140-1d1a6860496d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.756072] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d46f6f3-a453-4374-8140-1d1a6860496d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.756263] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d46f6f3-a453-4374-8140-1d1a6860496d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.868213] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: SUCCESS [ 1150.868484] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded deletion is rescheduled due to dependency. [ 1150.868621] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.258186] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e429593-1cb3-44b2-8d70-77fbe7afbed5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.258186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.261684] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d46f6f3-a453-4374-8140-1d1a6860496d with status ACTIVE [ 1151.261831] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.261965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.262048] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.262286] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.262370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.262559] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.262661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.262722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.263565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.263565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.263565] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.263565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.263565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.263565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.263565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.263862] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d46f6f3-a453-4374-8140-1d1a6860496d is going to be updated. [ 1151.293645] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.293820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.293862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.294219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.294361] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.294526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d46f6f3-a453-4374-8140-1d1a6860496d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.595847] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1151.595847] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.596037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.596297] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.596493] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.596973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.596973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.596973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.596973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.596973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.597213] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.707444] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 in Status: SUCCESS [ 1151.707608] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 deletion is rescheduled due to dependency. [ 1151.707731] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.707875] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.708130] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.708382] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.708505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.708563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.708726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.708805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.708898] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.994477] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea in Status: SUCCESS [ 1151.994477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.994477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.994477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.994477] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.994477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.994477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.994477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.994477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.994477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.994477] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7af49b3e-c32d-4c08-b110-379fb74e2bea',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.099375] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.099526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.099594] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.099813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.099981] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.100082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.100139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.100286] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.100368] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.100450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.100588] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.100690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.100725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.101692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.101692] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.101692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.101692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.101692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.101692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.101692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.101692] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.210919] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.277627] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: SUCCESS [ 1152.277905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.497797] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7af49b3e-c32d-4c08-b110-379fb74e2bea',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.603725] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c4cbecb-5529-4a33-ade6-6d4e0203047a: rpc.has_security_group_logging(os_id): False [ 1152.628170] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.628170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.628170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.628170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.628170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.628170] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.628170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.628170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.628170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.628170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.628614] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.628614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.629938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.629938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.629938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.629938] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.629938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.629938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.630257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.630257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.630257] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1152.713641] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.763460] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.763897] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.763897] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.764166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.764897] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.792181] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1153.002978] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7af49b3e-c32d-4c08-b110-379fb74e2bea: rpc.has_security_group_logging(os_id): False [ 1153.023593] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.024116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.024284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.024603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.024788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.025131] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.025344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.025496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.025752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.025903] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.026093] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea is going to be created. [ 1153.130292] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.130491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.130857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.130857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.131054] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.151688] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea in Status: IN_PROGRESS for 2s [ 1153.218091] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.218091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.218091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.218091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.218872] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.218872] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 is going to be updated. [ 1153.246709] env[65413]: INFO networking_nsxv3.common.synchronization [None req-41ec3f61-64a4-43e2-adc4-1b4ff3dbd81e tempest-AttachInterfacesTestJSON-635171845 tempest-AttachInterfacesTestJSON-635171845-project-member] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 1153.247278] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGHEST for action security_group_members [ 1153.247614] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.247726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.247786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.248021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.249660] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.249736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.249805] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.250139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.250139] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.250283] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.298906] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.299752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.299752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.299752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.299752] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.314427] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 in Status: IN_PROGRESS for 2s [ 1153.752990] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.753203] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.753319] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.753565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.753661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.753932] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.754079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.754145] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.754310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.754406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.754530] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be updated. [ 1153.787309] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.787481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.787525] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.787718] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.787856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.797691] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: IN_PROGRESS for 2s [ 1154.817187] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1154.817505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.166598] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea in Status: SUCCESS [ 1155.166598] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.328277] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 in Status: SUCCESS [ 1155.328277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.328277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.328277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.328478] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.328534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.328567] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.328727] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.328786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.328862] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.329722] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.500066] env[65413]: INFO networking_nsxv3.common.synchronization [req-beb17e26-8b97-49eb-a417-8563ee5eaeda req-70ca4148-385b-419f-846f-953dbfa87839 tempest-ListServerFiltersTestJSON-481585564 tempest-ListServerFiltersTestJSON-481585564-project-member] Enqueued Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1155.501125] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1155.501571] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.501743] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.501817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.502116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.502637] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.502637] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.502637] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.502637] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.502935] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.502935] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.813904] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 in Status: SUCCESS [ 1155.813904] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 deletion is rescheduled due to dependency. [ 1155.813904] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.831675] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e429593-1cb3-44b2-8d70-77fbe7afbed5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.832017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.832017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.832145] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.832316] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.832425] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.832490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.832644] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.832729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.832820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.832968] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e429593-1cb3-44b2-8d70-77fbe7afbed5 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.833068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.833128] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.833294] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.833464] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.833593] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.833655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.833799] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.833873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.833950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.834563] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.006341] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.336440] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e429593-1cb3-44b2-8d70-77fbe7afbed5: rpc.has_security_group_logging(os_id): False [ 1156.354678] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.354822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.354890] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.355133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.355221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.355443] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.355565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.355627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.355782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.355860] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.356049] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.356142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.356205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.356343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.356416] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.356587] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.356678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.356738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.356876] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.356947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.357041] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 is going to be updated. [ 1156.418309] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.418443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.418517] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.418740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.418889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.433805] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 in Status: IN_PROGRESS for 2s [ 1156.508374] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.010118] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.010445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.010445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.010590] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.010691] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.010795] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8645530-de9a-4187-9078-4d9ec14cdb6b is going to be updated. [ 1157.041519] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.041685] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.041765] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.042009] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.042179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.057924] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: IN_PROGRESS for 2s [ 1157.967809] env[65413]: INFO networking_nsxv3.common.synchronization [None req-ce266756-e55a-4f98-8cf3-619ae5efaa90 None None] Enqueued Resource ID: 66bfff39-8d88-4237-8021-6c1b76396297 with Priority: HIGHEST for action port [ 1157.968346] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66bfff39-8d88-4237-8021-6c1b76396297 with Priority: HIGHEST for action port [ 1157.968677] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-66bfff39-8d88-4237-8021-6c1b76396297 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.968813] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66bfff39-8d88-4237-8021-6c1b76396297" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.968861] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66bfff39-8d88-4237-8021-6c1b76396297" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.969141] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66bfff39-8d88-4237-8021-6c1b76396297" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.969215] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66bfff39-8d88-4237-8021-6c1b76396297',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.450423] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 in Status: SUCCESS [ 1158.450722] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.453361] env[65413]: INFO networking_nsxv3.common.synchronization [req-e47dbf9c-32ed-48de-a954-9c17cd6b9ad5 req-cc43158c-6e7c-4248-af98-271e338c2b38 tempest-ServersTestJSON-1291473095 tempest-ServersTestJSON-1291473095-project-member] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1158.453918] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1158.454318] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.454486] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.454559] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.454767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.454930] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.455059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.455189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.455372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.455467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.455564] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.470818] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66bfff39-8d88-4237-8021-6c1b76396297 [ 1158.471137] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.471329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.471406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.471614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.471695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.471791] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66bfff39-8d88-4237-8021-6c1b76396297 already deleted. [ 1158.471868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66bfff39-8d88-4237-8021-6c1b76396297" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.889614] env[65413]: INFO networking_nsxv3.common.synchronization [req-763c99f6-c32f-419d-9dad-bedf4efa34c6 req-44dbf0bf-3cdf-4c1a-9505-b210fe0505cc tempest-ServerActionsTestOtherB-69504015 tempest-ServerActionsTestOtherB-69504015-project-member] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1158.890386] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1158.893671] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.893671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.893671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.893671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.893671] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.893671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.893671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.893671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.893671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.893671] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.959225] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.070654] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: SUCCESS [ 1159.070872] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.276177] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.276177] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.276177] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.276177] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.276177] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.276617] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.276890] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.277299] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.277564] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.277873] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.278112] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1159.278316] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1159.278516] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1159.278719] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1159.278913] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1159.279161] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1159.299857] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1159.299857] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1159.299857] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1159.299857] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.299857] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.300497] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.301528] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.301528] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.301528] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f28dd771-4673-4f4e-a1ad-93bfd5ca4b86',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.397549] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.397672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.397716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.397931] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.398033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.398230] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.398333] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.398394] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.398546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.398622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.398709] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded is going to be updated. [ 1159.427122] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.427591] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.427669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.427879] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.428080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.445619] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: IN_PROGRESS for 2s [ 1159.461571] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.800640] env[65413]: INFO networking_nsxv3.common.synchronization [None req-e2aec1f4-b34e-4a92-b2a6-1240ca2736fe None None] Enqueued Resource ID: 4c310197-54e8-4767-ae10-bd78cf53bb46 with Priority: HIGHEST for action port [ 1159.801256] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c310197-54e8-4767-ae10-bd78cf53bb46 with Priority: HIGHEST for action port [ 1159.801567] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c310197-54e8-4767-ae10-bd78cf53bb46 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.801713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c310197-54e8-4767-ae10-bd78cf53bb46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.801781] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c310197-54e8-4767-ae10-bd78cf53bb46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.802739] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c310197-54e8-4767-ae10-bd78cf53bb46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.802739] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c310197-54e8-4767-ae10-bd78cf53bb46',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.806012] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.806206] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.806324] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.806614] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.806762] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.806908] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port f28dd771-4673-4f4e-a1ad-93bfd5ca4b86 not found, creating... [ 1159.807204] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.807324] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.807439] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.807649] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.807780] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.808315] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.808502] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.808620] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.808827] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.808959] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.809113] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: f28dd771-4673-4f4e-a1ad-93bfd5ca4b86 is going to be created. [ 1159.830197] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.830342] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.830905] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.830905] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.831042] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.831170] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.964450] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.964670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.964670] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.964798] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.964921] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.965105] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1159.998368] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.998368] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.998368] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.998368] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.998368] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.009606] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1160.307082] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4c310197-54e8-4767-ae10-bd78cf53bb46 [ 1160.307244] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.307352] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.307409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.307645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.308380] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.308380] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4c310197-54e8-4767-ae10-bd78cf53bb46 already deleted. [ 1160.308380] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c310197-54e8-4767-ae10-bd78cf53bb46" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.560094] env[65413]: INFO networking_nsxv3.common.synchronization [req-763c99f6-c32f-419d-9dad-bedf4efa34c6 req-0cfd5d85-9189-47c2-a4d9-bb6b1596efb3 service nova] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_rules [ 1160.560359] env[65413]: INFO networking_nsxv3.common.synchronization [req-763c99f6-c32f-419d-9dad-bedf4efa34c6 req-0cfd5d85-9189-47c2-a4d9-bb6b1596efb3 service nova] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1160.560392] env[65413]: INFO networking_nsxv3.common.synchronization [req-763c99f6-c32f-419d-9dad-bedf4efa34c6 req-0cfd5d85-9189-47c2-a4d9-bb6b1596efb3 service nova] Enqueued Resource ID: f28dd771-4673-4f4e-a1ad-93bfd5ca4b86 with Priority: HIGHEST for action port [ 1160.560614] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_rules [ 1160.560733] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1160.560826] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f28dd771-4673-4f4e-a1ad-93bfd5ca4b86 with Priority: HIGHEST for action port [ 1160.561947] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.561947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.562193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.562498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.563465] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.565850] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.565978] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.566314] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.566369] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.566439] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.566656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.566781] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f28dd771-4673-4f4e-a1ad-93bfd5ca4b86',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.650822] env[65413]: INFO networking_nsxv3.common.synchronization [req-c416a4ed-034b-4f0f-9d77-7f58215c0557 req-787dcc7c-4701-4c86-acbe-5de366ceda46 tempest-ServerActionsTestOtherA-276981019 tempest-ServerActionsTestOtherA-276981019-project-member] Enqueued Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_members [ 1160.651414] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 with Priority: HIGHEST for action security_group_members [ 1160.651886] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e429593-1cb3-44b2-8d70-77fbe7afbed5 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.651886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.652088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.652229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.652305] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.652399] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.652469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.652595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.652674] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.652799] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e429593-1cb3-44b2-8d70-77fbe7afbed5',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.696330] env[65413]: INFO networking_nsxv3.common.synchronization [req-c416a4ed-034b-4f0f-9d77-7f58215c0557 req-787dcc7c-4701-4c86-acbe-5de366ceda46 tempest-ServerActionsTestOtherA-276981019 tempest-ServerActionsTestOtherA-276981019-project-member] Enqueued Resource ID: 0d46f6f3-a453-4374-8140-1d1a6860496d with Priority: HIGHEST for action port [ 1160.696988] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d46f6f3-a453-4374-8140-1d1a6860496d with Priority: HIGHEST for action port [ 1160.697603] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d46f6f3-a453-4374-8140-1d1a6860496d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.697772] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d46f6f3-a453-4374-8140-1d1a6860496d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.697826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d46f6f3-a453-4374-8140-1d1a6860496d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.698038] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d46f6f3-a453-4374-8140-1d1a6860496d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.698199] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d46f6f3-a453-4374-8140-1d1a6860496d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.069611] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.069804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.069927] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f28dd771-4673-4f4e-a1ad-93bfd5ca4b86 with status ACTIVE [ 1161.070214] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.070386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.070386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.070535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.070622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.070915] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.070915] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.071025] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.071110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.071191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.071489] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.071489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.071637] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.071736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.071833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.071945] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f28dd771-4673-4f4e-a1ad-93bfd5ca4b86 is going to be updated. [ 1161.094416] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.094594] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.094690] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.094908] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.095067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.095888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.157103] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.157294] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.157438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.157656] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.157754] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.157960] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.158083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.158142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.158309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.158384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.158460] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 is going to be updated. [ 1161.200143] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d46f6f3-a453-4374-8140-1d1a6860496d with status ACTIVE [ 1161.200420] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.200563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.200625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.201549] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.201549] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.201549] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.201549] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.201549] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.201838] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.201942] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.202208] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.202317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.202381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.202545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.202613] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.202686] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d46f6f3-a453-4374-8140-1d1a6860496d is going to be updated. [ 1161.208391] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.208603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.208709] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.209059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.209239] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.223630] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 in Status: IN_PROGRESS for 2s [ 1161.244995] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.245354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.245354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.245624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.245823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.246030] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d46f6f3-a453-4374-8140-1d1a6860496d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.452459] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: SUCCESS [ 1161.452994] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded deletion is rescheduled due to dependency. [ 1161.453317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.453558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.453810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.454052] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.454217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.454328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.454646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.454646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.454743] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.958165] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.020438] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1162.020694] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.460402] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.506748] env[65413]: INFO networking_nsxv3.common.synchronization [req-7d5baed5-dae3-4b11-9d1a-891301efbd58 req-8a781d5d-46aa-48fd-89d7-a9a20477aa41 tempest-ListServerFiltersTestJSON-481585564 tempest-ListServerFiltersTestJSON-481585564-project-member] Enqueued Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1162.507333] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8645530-de9a-4187-9078-4d9ec14cdb6b with Priority: HIGHEST for action security_group_members [ 1162.507646] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d8645530-de9a-4187-9078-4d9ec14cdb6b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.507768] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.507849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.508365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.508543] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.508729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.508729] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.508920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.509015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.509121] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d8645530-de9a-4187-9078-4d9ec14cdb6b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.963525] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.963836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.963836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.964063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.964194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.964347] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded is going to be updated. [ 1162.995239] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.995395] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.995432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.995654] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.995796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.005167] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: IN_PROGRESS for 2s [ 1163.012757] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.012948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.012948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.013142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.013286] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.013497] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.013602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.013664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.013867] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.013906] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.014008] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8645530-de9a-4187-9078-4d9ec14cdb6b is going to be updated. [ 1163.045284] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.045423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.045492] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.045770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.045910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.056489] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: IN_PROGRESS for 2s [ 1163.234901] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 in Status: SUCCESS [ 1163.235105] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e429593-1cb3-44b2-8d70-77fbe7afbed5 deletion is rescheduled due to dependency. [ 1163.235243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e429593-1cb3-44b2-8d70-77fbe7afbed5" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.836411] env[65413]: INFO networking_nsxv3.common.synchronization [req-f3c5d9dd-09f4-430a-87fa-83431acaa6d4 req-dcc13e29-412a-415a-b771-78b3613c7d95 tempest-ServersTestJSON-1291473095 tempest-ServersTestJSON-1291473095-project-member] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1164.836933] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1164.837256] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.837378] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.837445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.837620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.837842] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.837947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.838015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.838248] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.838248] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.838343] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.876462] env[65413]: INFO networking_nsxv3.common.synchronization [req-2d7a20fb-45ea-4d87-90d3-ce21392c1d8e req-e3be02ee-9a64-4e01-bad3-5c325bac2bd3 tempest-ListServersNegativeTestJSON-257438915 tempest-ListServersNegativeTestJSON-257438915-project-member] Enqueued Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1164.877065] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1164.877706] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.877706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.877706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.878118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.878363] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.878434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.878473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.878662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.878759] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.878880] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.016290] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: SUCCESS [ 1165.016290] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.016290] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.016671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.016738] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.016835] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.016898] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.017028] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.017104] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.017181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.017271] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.065896] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d8645530-de9a-4187-9078-4d9ec14cdb6b in Status: SUCCESS [ 1165.066100] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d8645530-de9a-4187-9078-4d9ec14cdb6b deletion is rescheduled due to dependency. [ 1165.066232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d8645530-de9a-4187-9078-4d9ec14cdb6b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.193414] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-674 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.193692] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-674" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.193876] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-674" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.194269] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-674" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.194622] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.194901] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.195232] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.195595] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.195802] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.196191] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.196370] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.196488] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.196598] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.196715] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.196886] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.197049] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.218871] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.219091] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1165.219241] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.219453] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-674" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.220271] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.220271] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.220629] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.221068] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.221297] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.340683] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.381084] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.381379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.381530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.381767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.381942] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.382261] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.382449] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.382556] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.382775] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.382919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.383094] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 already deleted. [ 1165.383281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.520496] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.724077] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.724348] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.724508] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.728020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.728020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.728020] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3 not found, creating... [ 1165.728020] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.728020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.728020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.728020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.728020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.728020] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.728020] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.728416] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.728416] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.728416] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.728416] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3 is going to be created. [ 1165.748743] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.748959] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.749093] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.749478] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.749590] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.750376] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.843255] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.023085] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4aeeb11-908b-4980-9ebd-3c96e2724ded: rpc.has_security_group_logging(os_id): False [ 1166.039949] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.040201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.040201] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.040369] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.040458] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.040702] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.040801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.040863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.041027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.041109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.041193] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded is going to be updated. [ 1166.097078] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.097251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.097251] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.097661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.097661] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.118944] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: IN_PROGRESS for 2s [ 1166.345523] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.345834] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.345928] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.346209] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.346335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.346443] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1166.380739] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.380950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.380950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.381170] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.381321] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.392389] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1166.477640] env[65413]: INFO networking_nsxv3.common.synchronization [req-2d7a20fb-45ea-4d87-90d3-ce21392c1d8e req-4fa71144-ee7c-418a-b841-b135e9584664 service nova] Enqueued Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_rules [ 1166.477830] env[65413]: INFO networking_nsxv3.common.synchronization [req-2d7a20fb-45ea-4d87-90d3-ce21392c1d8e req-4fa71144-ee7c-418a-b841-b135e9584664 service nova] Enqueued Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1166.477966] env[65413]: INFO networking_nsxv3.common.synchronization [req-2d7a20fb-45ea-4d87-90d3-ce21392c1d8e req-4fa71144-ee7c-418a-b841-b135e9584664 service nova] Enqueued Resource ID: 7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3 with Priority: HIGHEST for action port [ 1166.478505] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_rules [ 1166.479071] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1166.479210] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3 with Priority: HIGHEST for action port [ 1166.479515] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.479637] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.479706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.480498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.480498] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.480997] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.481081] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.481118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.481316] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.481481] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.481563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.481618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.481739] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.481844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.481982] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.482835] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.482995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.482995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.483603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.483603] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.985173] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.985513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.986661] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.987945] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3 with status ACTIVE [ 1166.988178] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.988300] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.988367] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.988591] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.988678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.988853] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.988950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.989017] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.989166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.989240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.989419] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.989538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.989603] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.989746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.989817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.989899] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3 is going to be updated. [ 1167.013216] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.013538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.013696] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.013950] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.014166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.014419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fe5695d-e6da-4b9f-9eb5-e4a5e368c1e3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.152479] env[65413]: INFO networking_nsxv3.common.synchronization [req-2d7a20fb-45ea-4d87-90d3-ce21392c1d8e req-cedceab7-c4d5-4ca1-bf6b-0e348624d219 tempest-ListServersNegativeTestJSON-257438915 tempest-ListServersNegativeTestJSON-257438915-project-member] Enqueued Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1167.154957] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1167.155633] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.155770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.494052] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.495705] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-674 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.495879] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-674" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.495994] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-674" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.496765] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-674" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.497161] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.497612] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.497612] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.498439] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.498439] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.498439] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1167.498439] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1167.498439] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1167.499176] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1167.499176] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1167.499176] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1167.499176] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1167.521082] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1167.521287] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1167.521495] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1167.521710] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-674" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.522034] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-f6dba970-91a1-4d3d-aad7-acebafe0a79d taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.522208] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-f6dba970-91a1-4d3d-aad7-acebafe0a79d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.522325] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-f6dba970-91a1-4d3d-aad7-acebafe0a79d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.522661] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-f6dba970-91a1-4d3d-aad7-acebafe0a79d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.522796] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6dba970-91a1-4d3d-aad7-acebafe0a79d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.000647] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.001063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.001063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.001163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.001197] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.001323] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 is going to be created. [ 1168.025351] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.025548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.025688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.025910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.026149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.029063] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.029063] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.029063] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.029063] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.029476] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.029661] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port f6dba970-91a1-4d3d-aad7-acebafe0a79d not found, creating... [ 1168.029969] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.030254] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.030458] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.030797] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.031056] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.031513] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.031781] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.032349] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.032349] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.032551] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.032756] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: f6dba970-91a1-4d3d-aad7-acebafe0a79d is going to be created. [ 1168.046181] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: UNINITIALIZED for 2s [ 1168.059391] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.059613] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.059742] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.060024] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.060250] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.060468] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-f6dba970-91a1-4d3d-aad7-acebafe0a79d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.152938] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: SUCCESS [ 1168.152938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.403471] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1168.403682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.748589] env[65413]: INFO networking_nsxv3.common.synchronization [req-2d7a20fb-45ea-4d87-90d3-ce21392c1d8e req-e2922c6b-8ad9-43bb-999b-052021d69e14 service nova] Enqueued Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_rules [ 1168.748809] env[65413]: INFO networking_nsxv3.common.synchronization [req-2d7a20fb-45ea-4d87-90d3-ce21392c1d8e req-e2922c6b-8ad9-43bb-999b-052021d69e14 service nova] Enqueued Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1168.748958] env[65413]: INFO networking_nsxv3.common.synchronization [req-2d7a20fb-45ea-4d87-90d3-ce21392c1d8e req-e2922c6b-8ad9-43bb-999b-052021d69e14 service nova] Enqueued Resource ID: f6dba970-91a1-4d3d-aad7-acebafe0a79d with Priority: HIGHEST for action port [ 1168.749507] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_rules [ 1168.749637] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1168.749765] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6dba970-91a1-4d3d-aad7-acebafe0a79d with Priority: HIGHEST for action port [ 1168.750018] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.750283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.750483] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.750632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.750857] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6dba970-91a1-4d3d-aad7-acebafe0a79d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.751066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6dba970-91a1-4d3d-aad7-acebafe0a79d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.751161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6dba970-91a1-4d3d-aad7-acebafe0a79d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.751426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6dba970-91a1-4d3d-aad7-acebafe0a79d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.751541] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6dba970-91a1-4d3d-aad7-acebafe0a79d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.254441] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6dba970-91a1-4d3d-aad7-acebafe0a79d with status ACTIVE [ 1169.254809] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.254897] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.254975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.255247] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.255418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.255544] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.255674] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.255738] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.255897] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.255979] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.256185] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.256285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.256349] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.256493] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.256570] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.256655] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6dba970-91a1-4d3d-aad7-acebafe0a79d is going to be updated. [ 1169.283532] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.283681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.283737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.283974] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.284129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.284495] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6dba970-91a1-4d3d-aad7-acebafe0a79d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.447805] env[65413]: INFO networking_nsxv3.common.synchronization [req-2d7a20fb-45ea-4d87-90d3-ce21392c1d8e req-5f205cfb-76bb-4664-a1db-d94a7d4b8621 tempest-ListServersNegativeTestJSON-257438915 tempest-ListServersNegativeTestJSON-257438915-project-member] Enqueued Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1169.448458] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1169.448912] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.449103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.746448] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-674 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.746654] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-674" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.746779] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-674" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.747051] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-674" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.747330] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.747545] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.747694] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.747968] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.748190] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.748477] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.748609] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1169.748718] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1169.748825] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1169.748933] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1169.749047] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1169.749189] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1169.767697] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1169.767849] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1169.767991] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1169.768685] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-674" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.769097] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-dd23e159-f8a5-4805-b4a6-1f686419ad08 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.769290] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-dd23e159-f8a5-4805-b4a6-1f686419ad08" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.769410] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-dd23e159-f8a5-4805-b4a6-1f686419ad08" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.769804] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-dd23e159-f8a5-4805-b4a6-1f686419ad08" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.769941] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd23e159-f8a5-4805-b4a6-1f686419ad08',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.056187] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: SUCCESS [ 1170.056405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.056574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.056849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.057077] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.057226] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.057295] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.057463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.057535] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.057622] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.057715] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.058545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.058721] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.058907] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.059022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.059088] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.059232] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.059308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.059393] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.272267] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.272673] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.272790] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.273154] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.273389] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.273602] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port dd23e159-f8a5-4805-b4a6-1f686419ad08 not found, creating... [ 1170.273988] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.274420] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.274605] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.275580] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.275580] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.275580] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.275867] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.276905] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.276905] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.276905] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.276905] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: dd23e159-f8a5-4805-b4a6-1f686419ad08 is going to be created. [ 1170.312218] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.312542] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.312746] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.313074] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.313436] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.313770] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-dd23e159-f8a5-4805-b4a6-1f686419ad08" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.560901] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.560901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.561123] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.062896] env[65413]: INFO networking_nsxv3.common.synchronization [req-2d7a20fb-45ea-4d87-90d3-ce21392c1d8e req-38c7e9e3-f350-4a34-a927-bd4d573df342 service nova] Enqueued Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_rules [ 1171.063158] env[65413]: INFO networking_nsxv3.common.synchronization [req-2d7a20fb-45ea-4d87-90d3-ce21392c1d8e req-38c7e9e3-f350-4a34-a927-bd4d573df342 service nova] Enqueued Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1171.063374] env[65413]: INFO networking_nsxv3.common.synchronization [req-2d7a20fb-45ea-4d87-90d3-ce21392c1d8e req-38c7e9e3-f350-4a34-a927-bd4d573df342 service nova] Enqueued Resource ID: dd23e159-f8a5-4805-b4a6-1f686419ad08 with Priority: HIGHEST for action port [ 1171.064378] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.065734] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_rules [ 1171.065789] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1171.065893] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd23e159-f8a5-4805-b4a6-1f686419ad08 with Priority: HIGHEST for action port [ 1171.066460] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.066460] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.066593] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.066651] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.066893] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd23e159-f8a5-4805-b4a6-1f686419ad08 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.066986] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd23e159-f8a5-4805-b4a6-1f686419ad08" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.067040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd23e159-f8a5-4805-b4a6-1f686419ad08" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.067257] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd23e159-f8a5-4805-b4a6-1f686419ad08" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.067343] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd23e159-f8a5-4805-b4a6-1f686419ad08',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.569700] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.569700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.570093] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.570093] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.570093] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.570221] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 is going to be updated. [ 1171.571515] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd23e159-f8a5-4805-b4a6-1f686419ad08 with status ACTIVE [ 1171.571726] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.571899] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.571899] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.572097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.572298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.572408] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.572463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.572499] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.572675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.572736] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.572931] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.573041] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.573220] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.573553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.573553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.573553] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd23e159-f8a5-4805-b4a6-1f686419ad08 is going to be updated. [ 1171.599514] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.599846] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.599963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.600365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.600658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.601027] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd23e159-f8a5-4805-b4a6-1f686419ad08" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.612516] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.612782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.612888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.613209] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.613507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.628894] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: IN_PROGRESS for 2s [ 1173.641112] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: SUCCESS [ 1173.641481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.641481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.641721] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.642180] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.642180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.642180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.642367] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.642367] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.642487] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.146045] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.650488] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.757466] env[65413]: INFO networking_nsxv3.common.synchronization [None req-f991d128-69ab-4226-b9fc-4d9ab67fc799 None None] Enqueued Resource ID: 0185b6c4-758b-43eb-bb47-d82d553c8a02 with Priority: HIGHEST for action port [ 1174.758010] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0185b6c4-758b-43eb-bb47-d82d553c8a02 with Priority: HIGHEST for action port [ 1174.758333] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-0185b6c4-758b-43eb-bb47-d82d553c8a02 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.758457] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0185b6c4-758b-43eb-bb47-d82d553c8a02" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.758524] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0185b6c4-758b-43eb-bb47-d82d553c8a02" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.758775] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0185b6c4-758b-43eb-bb47-d82d553c8a02" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.758859] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0185b6c4-758b-43eb-bb47-d82d553c8a02',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.151738] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.151919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.152026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.152299] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.152405] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.152539] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 is going to be updated. [ 1175.187095] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.187095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.187353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.187536] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.187720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.200654] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: IN_PROGRESS for 2s [ 1175.261712] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0185b6c4-758b-43eb-bb47-d82d553c8a02 [ 1175.262646] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.262940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.263267] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.263675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.263916] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.264112] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0185b6c4-758b-43eb-bb47-d82d553c8a02 already deleted. [ 1175.264412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0185b6c4-758b-43eb-bb47-d82d553c8a02" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.728030] env[65413]: INFO networking_nsxv3.common.synchronization [None req-d5bf7e43-ff95-4ed9-834e-ab157f08b154 None None] Enqueued Resource ID: 26385443-67d4-4a40-92ed-abb29c18e5ec with Priority: HIGHEST for action port [ 1176.728386] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26385443-67d4-4a40-92ed-abb29c18e5ec with Priority: HIGHEST for action port [ 1176.728678] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-26385443-67d4-4a40-92ed-abb29c18e5ec taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.728795] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26385443-67d4-4a40-92ed-abb29c18e5ec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.728849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26385443-67d4-4a40-92ed-abb29c18e5ec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.729161] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26385443-67d4-4a40-92ed-abb29c18e5ec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.729243] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26385443-67d4-4a40-92ed-abb29c18e5ec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.218291] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: SUCCESS [ 1177.218291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.218291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.218291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.218291] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.218291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.219212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.219478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.219577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.220328] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.234888] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26385443-67d4-4a40-92ed-abb29c18e5ec [ 1177.235217] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.236063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.236063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.236462] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.236462] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.236462] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26385443-67d4-4a40-92ed-abb29c18e5ec already deleted. [ 1177.236608] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26385443-67d4-4a40-92ed-abb29c18e5ec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.722591] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.225784] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.729530] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.730267] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.730267] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.730386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.730419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.730532] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 is going to be updated. [ 1178.779189] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.779189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.779189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.779189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.779189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.791407] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: IN_PROGRESS for 2s [ 1178.950530] env[65413]: INFO networking_nsxv3.common.synchronization [req-ef230f78-68ad-4ec4-b53c-53bacbc5bdf2 req-ce7d8389-fadd-47a4-942d-c0ea20764551 tempest-ServersTestJSON-1291473095 tempest-ServersTestJSON-1291473095-project-member] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1178.951095] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1178.951450] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.951647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.951647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.951857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.952047] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.952115] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.952182] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.952324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.952406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.952518] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.280763] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.281086] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.281222] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.281596] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.281900] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.282109] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.282235] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.282814] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.283406] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.283406] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.283406] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.283572] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.283572] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.283696] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.283930] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.284016] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.306825] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.307049] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1179.307282] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.307488] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.307833] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-200f7925-d370-4670-89a9-15fea7e151f6 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.308037] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-200f7925-d370-4670-89a9-15fea7e151f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.308161] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-200f7925-d370-4670-89a9-15fea7e151f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.308518] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-200f7925-d370-4670-89a9-15fea7e151f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.308657] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('200f7925-d370-4670-89a9-15fea7e151f6',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.454857] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.811250] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.811366] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.811502] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.811748] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.811904] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.812069] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 200f7925-d370-4670-89a9-15fea7e151f6 not found, creating... [ 1179.812344] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.812845] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.812845] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.812845] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.813064] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.813247] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.813440] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.813590] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.813847] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.814015] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.814187] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 200f7925-d370-4670-89a9-15fea7e151f6 is going to be created. [ 1179.835104] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.835350] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.835446] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.835723] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.835948] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.836186] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-200f7925-d370-4670-89a9-15fea7e151f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.957380] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.460146] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.460496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.460496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.460677] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.460818] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.460943] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1180.493595] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.494436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.494436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.495181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.495181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.504692] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1180.584763] env[65413]: INFO networking_nsxv3.common.synchronization [req-ef230f78-68ad-4ec4-b53c-53bacbc5bdf2 req-0693efeb-6172-4631-90b6-773256508155 service nova] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_rules [ 1180.584943] env[65413]: INFO networking_nsxv3.common.synchronization [req-ef230f78-68ad-4ec4-b53c-53bacbc5bdf2 req-0693efeb-6172-4631-90b6-773256508155 service nova] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1180.585093] env[65413]: INFO networking_nsxv3.common.synchronization [req-ef230f78-68ad-4ec4-b53c-53bacbc5bdf2 req-0693efeb-6172-4631-90b6-773256508155 service nova] Enqueued Resource ID: 200f7925-d370-4670-89a9-15fea7e151f6 with Priority: HIGHEST for action port [ 1180.586554] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_rules [ 1180.586758] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1180.586920] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 200f7925-d370-4670-89a9-15fea7e151f6 with Priority: HIGHEST for action port [ 1180.587178] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.587307] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.587376] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.587585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.587666] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.589033] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.589033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.589033] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-200f7925-d370-4670-89a9-15fea7e151f6 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.589033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-200f7925-d370-4670-89a9-15fea7e151f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.589249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-200f7925-d370-4670-89a9-15fea7e151f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.589326] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-200f7925-d370-4670-89a9-15fea7e151f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.589406] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('200f7925-d370-4670-89a9-15fea7e151f6',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.802115] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: SUCCESS [ 1180.802329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.802494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.802713] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.802911] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.803052] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.803134] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.803300] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.803428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.803520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.803690] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.803763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.803821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.803973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.804110] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.804192] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.804245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.804421] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.804477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.804556] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.804651] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.805582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.805737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.805876] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.805975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.806049] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.806189] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.806262] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.806348] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.093040] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.093040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.093040] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 200f7925-d370-4670-89a9-15fea7e151f6 with status ACTIVE [ 1181.093040] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.093040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.093040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.093466] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.093604] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.093789] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.093887] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.093968] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.094207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.094308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.094519] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.094647] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.094723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.094932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.094997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.095060] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 200f7925-d370-4670-89a9-15fea7e151f6 is going to be updated. [ 1181.117255] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.117666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.117666] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.117776] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.117953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.118123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-200f7925-d370-4670-89a9-15fea7e151f6" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.228083] env[65413]: INFO networking_nsxv3.common.synchronization [req-3dbc9988-fc97-45d9-a779-02d23dca8365 req-0fffb410-d1e8-40a8-a880-04a65f8f4fb5 tempest-ServerAddressesTestJSON-1720970883 tempest-ServerAddressesTestJSON-1720970883-project-member] Enqueued Resource ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf with Priority: HIGHEST for action security_group_members [ 1181.228584] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf with Priority: HIGHEST for action security_group_members [ 1181.228891] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dabc25b-0637-431c-a102-2d70f0ed1abf taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.229075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.229225] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.229502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.229657] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.229763] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.229829] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.229993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.230098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.230169] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dabc25b-0637-431c-a102-2d70f0ed1abf',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.309110] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.310264] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7e128bf-9aa1-47de-ae18-15ee117a8003: rpc.has_security_group_logging(os_id): False [ 1181.330775] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.331009] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.331009] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.331215] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.331337] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.331564] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.331667] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.331723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.331883] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.331965] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.332160] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.332298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.332298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.332428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.332500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.332672] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.332762] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.332825] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.332952] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.333043] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.333107] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 is going to be created. [ 1181.400890] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.401153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.401319] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.401938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.401938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.416228] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: IN_PROGRESS for 2s [ 1181.596307] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.596672] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-547" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.596904] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-547" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.597377] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-547" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.597773] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.598016] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.598196] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.598549] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.598789] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.599137] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1181.599338] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1181.599532] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1181.599726] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1181.599921] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1181.600132] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1181.600365] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1181.620063] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1181.620234] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1181.620313] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1181.620504] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-547" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.620846] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-ec822f20-29d7-4c21-96b6-69910251546a taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.621068] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-ec822f20-29d7-4c21-96b6-69910251546a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.621215] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-ec822f20-29d7-4c21-96b6-69910251546a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.621650] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-ec822f20-29d7-4c21-96b6-69910251546a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.621795] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec822f20-29d7-4c21-96b6-69910251546a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.733199] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.733433] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.733484] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.733695] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.733779] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.733989] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.734098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.734158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.734362] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.734447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.734550] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf already deleted. [ 1181.734629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.812586] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.125018] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.125515] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.125817] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.126310] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.126614] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.126877] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port ec822f20-29d7-4c21-96b6-69910251546a not found, creating... [ 1182.127331] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.127903] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.128139] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.128499] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.128716] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.129177] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.129433] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.129621] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.129962] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.130192] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.130419] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: ec822f20-29d7-4c21-96b6-69910251546a is going to be created. [ 1182.154569] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.154828] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.155082] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.155373] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.155626] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.155934] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-ec822f20-29d7-4c21-96b6-69910251546a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.315216] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.315430] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.315515] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.315758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.315853] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.315954] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 is going to be updated. [ 1182.360302] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.360558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.360558] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.360740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.360891] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.373033] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: IN_PROGRESS for 2s [ 1182.515483] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1182.515728] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.515912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.516209] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.516440] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.516687] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.516767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.516974] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.517101] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.517205] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.883719] env[65413]: INFO networking_nsxv3.common.synchronization [req-3dbc9988-fc97-45d9-a779-02d23dca8365 req-0e603c5d-327e-417e-9a11-9239dc774a9c service nova] Enqueued Resource ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf with Priority: HIGHEST for action security_group_rules [ 1182.884041] env[65413]: INFO networking_nsxv3.common.synchronization [req-3dbc9988-fc97-45d9-a779-02d23dca8365 req-0e603c5d-327e-417e-9a11-9239dc774a9c service nova] Enqueued Resource ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf with Priority: HIGHEST for action security_group_members [ 1182.884041] env[65413]: INFO networking_nsxv3.common.synchronization [req-3dbc9988-fc97-45d9-a779-02d23dca8365 req-0e603c5d-327e-417e-9a11-9239dc774a9c service nova] Enqueued Resource ID: ec822f20-29d7-4c21-96b6-69910251546a with Priority: HIGHEST for action port [ 1182.884574] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf with Priority: HIGHEST for action security_group_rules [ 1182.885176] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf with Priority: HIGHEST for action security_group_members [ 1182.885320] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec822f20-29d7-4c21-96b6-69910251546a with Priority: HIGHEST for action port [ 1182.885610] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dabc25b-0637-431c-a102-2d70f0ed1abf taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.885731] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.885798] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.886079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.886166] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dabc25b-0637-431c-a102-2d70f0ed1abf',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.887550] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dabc25b-0637-431c-a102-2d70f0ed1abf taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.887786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.887945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.888097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.888322] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.888464] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.888553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.888779] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.889745] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.889745] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dabc25b-0637-431c-a102-2d70f0ed1abf',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.891342] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec822f20-29d7-4c21-96b6-69910251546a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.891342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec822f20-29d7-4c21-96b6-69910251546a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.891543] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec822f20-29d7-4c21-96b6-69910251546a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.891653] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec822f20-29d7-4c21-96b6-69910251546a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.891796] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec822f20-29d7-4c21-96b6-69910251546a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.019151] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.333195] env[65413]: INFO networking_nsxv3.common.synchronization [req-01e6bfcd-088d-4880-9844-84a3653964e4 req-1f975d26-9bd4-4167-8981-3e997fcded41 tempest-ListServersNegativeTestJSON-257438915 tempest-ListServersNegativeTestJSON-257438915-project-member] Enqueued Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1183.333813] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1183.334136] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.334233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.389258] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dabc25b-0637-431c-a102-2d70f0ed1abf taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.389445] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.391915] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dabc25b-0637-431c-a102-2d70f0ed1abf',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.393225] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec822f20-29d7-4c21-96b6-69910251546a with status ACTIVE [ 1183.393443] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.393576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.393633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.393837] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.393918] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.394110] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.394205] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.394259] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.394413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.394478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.394655] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.394740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.394796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.394927] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.394994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.395529] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec822f20-29d7-4c21-96b6-69910251546a is going to be updated. [ 1183.420504] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.421680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.421680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.421680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.421680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.421680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec822f20-29d7-4c21-96b6-69910251546a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.430680] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: SUCCESS [ 1183.430680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.430680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.430680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.430680] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.521495] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.897775] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dabc25b-0637-431c-a102-2d70f0ed1abf',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.933073] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.933073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.026019] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.026325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.026325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.026619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.026741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.026835] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1184.065109] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.065266] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.065313] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.066492] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.066492] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.081473] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1184.384020] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: SUCCESS [ 1184.384268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.384538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.384860] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.385177] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.385358] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.385461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.385715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.385848] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.385996] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.400457] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.400595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.400664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.400995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.400995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.401101] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf is going to be created. [ 1184.432967] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.433165] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.433165] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.433430] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.433589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.443964] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf in Status: UNINITIALIZED for 2s [ 1184.889025] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.391458] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.894391] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.894391] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.894501] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.894703] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.894809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.894920] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 is going to be updated. [ 1185.926839] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.927020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.927079] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.927377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.927612] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.937627] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: IN_PROGRESS for 2s [ 1186.091211] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1186.091465] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.091710] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.091954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.092224] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.092335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.092376] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.092519] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.092601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.092688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.092776] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.356200] env[65413]: INFO networking_nsxv3.common.synchronization [req-a4cfc46e-f152-41d9-ab03-f69b2b7f8de6 req-85cdaf8a-742c-45bc-9b6d-5ff75ff1f8dd tempest-ServerActionsTestOtherA-276981019 tempest-ServerActionsTestOtherA-276981019-project-member] Enqueued Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_members [ 1186.356731] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_members [ 1186.358203] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba978295-db66-4f6f-800c-d69ad3fc5fec taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.358203] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.358319] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.359209] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.359431] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.359615] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.359680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.360243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.360243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.360243] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.454562] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf in Status: SUCCESS [ 1186.454993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.454993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.455190] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.455400] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.455541] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.455614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.455829] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.455945] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.456023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.456112] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dabc25b-0637-431c-a102-2d70f0ed1abf',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.596067] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.596067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.596067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.596067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.596624] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.596624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.596624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.596624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.596624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.596870] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.596870] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.596870] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.596982] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.598896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.598896] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.598896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.598896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.598896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.598896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.598896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.598896] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.711614] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-598 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.711869] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.712033] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.712367] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.712652] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.712806] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.712919] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.713349] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.713349] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.713633] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1186.713735] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1186.713837] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1186.713940] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1186.714063] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1186.714166] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1186.714298] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1186.736808] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1186.737057] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1186.737150] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1186.737374] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-598" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.737715] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-304dbe2d-e7d9-4261-bd94-b9928f3dbc05 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.737927] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-304dbe2d-e7d9-4261-bd94-b9928f3dbc05" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.739099] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-304dbe2d-e7d9-4261-bd94-b9928f3dbc05" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.739099] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-304dbe2d-e7d9-4261-bd94-b9928f3dbc05" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.739099] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('304dbe2d-e7d9-4261-bd94-b9928f3dbc05',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.863816] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.959138] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dabc25b-0637-431c-a102-2d70f0ed1abf taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.959373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.959434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.959708] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.959932] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.960085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.960154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.960312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.960399] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.960486] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.960631] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dabc25b-0637-431c-a102-2d70f0ed1abf taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.960724] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.960782] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.960920] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.961072] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.961163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.961223] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.961398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.961470] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.961583] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.961712] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dabc25b-0637-431c-a102-2d70f0ed1abf',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.101710] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c4cbecb-5529-4a33-ade6-6d4e0203047a: rpc.has_security_group_logging(os_id): False [ 1187.126301] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.126476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.126521] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.126758] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.126849] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.127086] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.127184] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.127238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.127399] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.127462] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.127643] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.127735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.127793] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.128057] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.128133] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.128347] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.128442] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.128513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.128698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.128783] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.128854] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1187.211214] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.211214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.211440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.211581] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.211734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.235613] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1187.243610] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.244054] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.244297] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.244728] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.244993] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.245261] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 304dbe2d-e7d9-4261-bd94-b9928f3dbc05 not found, creating... [ 1187.245701] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.245952] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.246136] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.246479] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.246659] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.247105] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.247348] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.247529] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.247850] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.248079] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.248301] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 304dbe2d-e7d9-4261-bd94-b9928f3dbc05 is going to be created. [ 1187.294892] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.295268] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.295358] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.296022] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.296022] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.296229] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-304dbe2d-e7d9-4261-bd94-b9928f3dbc05" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.365933] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.464188] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dabc25b-0637-431c-a102-2d70f0ed1abf: rpc.has_security_group_logging(os_id): False [ 1187.487575] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.487764] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.487934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.488240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.488341] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.488586] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.488726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.488815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.489077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.489179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.489387] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.489489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.489548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.489701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.489775] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.489955] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.490061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.490123] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.490277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.490351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.490439] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf is going to be created. [ 1187.560919] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.561122] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.561168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.561372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.561548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.573302] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf in Status: IN_PROGRESS for 2s [ 1187.868471] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.868619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.868687] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.868910] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.868995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.869101] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba978295-db66-4f6f-800c-d69ad3fc5fec is going to be updated. [ 1187.902460] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.902460] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.902460] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.904995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.904995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.920117] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: IN_PROGRESS for 2s [ 1187.949308] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: SUCCESS [ 1187.949610] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.949784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.950008] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.950210] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.950344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.950409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.950568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.950649] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.950730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.950820] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.966272] env[65413]: INFO networking_nsxv3.common.synchronization [req-a4cfc46e-f152-41d9-ab03-f69b2b7f8de6 req-7f12f6bf-c1ce-4ba5-937f-3787efdd1c34 service nova] Enqueued Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_rules [ 1187.966507] env[65413]: INFO networking_nsxv3.common.synchronization [req-a4cfc46e-f152-41d9-ab03-f69b2b7f8de6 req-7f12f6bf-c1ce-4ba5-937f-3787efdd1c34 service nova] Enqueued Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_members [ 1187.966712] env[65413]: INFO networking_nsxv3.common.synchronization [req-a4cfc46e-f152-41d9-ab03-f69b2b7f8de6 req-7f12f6bf-c1ce-4ba5-937f-3787efdd1c34 service nova] Enqueued Resource ID: 304dbe2d-e7d9-4261-bd94-b9928f3dbc05 with Priority: HIGHEST for action port [ 1187.967671] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_rules [ 1187.968612] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_members [ 1187.968739] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 304dbe2d-e7d9-4261-bd94-b9928f3dbc05 with Priority: HIGHEST for action port [ 1187.969059] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba978295-db66-4f6f-800c-d69ad3fc5fec taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.969187] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.969253] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.969605] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.969605] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.970778] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba978295-db66-4f6f-800c-d69ad3fc5fec taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.970778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.970778] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-304dbe2d-e7d9-4261-bd94-b9928f3dbc05 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.970778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-304dbe2d-e7d9-4261-bd94-b9928f3dbc05" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.971163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-304dbe2d-e7d9-4261-bd94-b9928f3dbc05" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.971163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-304dbe2d-e7d9-4261-bd94-b9928f3dbc05" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.971163] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('304dbe2d-e7d9-4261-bd94-b9928f3dbc05',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.454075] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.454075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.454075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.454075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.454075] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.454075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.454075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.454639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.454639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.454639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.454639] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.454759] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.454759] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.454914] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.455047] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.455149] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.455206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.455344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.455420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.455498] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.455584] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.472381] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba978295-db66-4f6f-800c-d69ad3fc5fec taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.472880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.472880] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 304dbe2d-e7d9-4261-bd94-b9928f3dbc05 with status ACTIVE [ 1188.472880] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.473077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.473077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.473197] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.473285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.473498] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.473617] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.473681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.473841] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.473919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.474117] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.474212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.474271] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.474418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.474483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.474561] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 304dbe2d-e7d9-4261-bd94-b9928f3dbc05 is going to be updated. [ 1188.495115] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.495331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.495331] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.495513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.495639] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.496107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-304dbe2d-e7d9-4261-bd94-b9928f3dbc05" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.958028] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7e128bf-9aa1-47de-ae18-15ee117a8003: rpc.has_security_group_logging(os_id): False [ 1188.979820] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.980042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.980084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.980285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.980382] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.980754] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.980754] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.980934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.980934] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.980993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.981172] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.981266] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.981388] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.981461] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.981531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.981707] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.981798] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.981846] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.982007] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.982078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.982139] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 is going to be updated. [ 1189.053852] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.054148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.054148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.054353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.054478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.071233] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: IN_PROGRESS for 2s [ 1189.253026] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1189.253851] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.586414] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf in Status: SUCCESS [ 1189.586800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.933293] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: SUCCESS [ 1189.933588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.933801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.934012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.934239] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.934384] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.934457] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.934646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.934784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.934918] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.438062] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.539577] env[65413]: INFO networking_nsxv3.common.synchronization [req-b588c644-d78d-45ea-8724-8759cfd64517 req-4b1b3371-601c-46d5-8439-8d1cf6c839cf tempest-ListServersNegativeTestJSON-257438915 tempest-ListServersNegativeTestJSON-257438915-project-member] Enqueued Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1190.542659] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1190.543248] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.543474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.543592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.543822] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.544043] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.544182] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.544273] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.544476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.545453] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.545453] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.609023] env[65413]: INFO networking_nsxv3.common.synchronization [req-4309e82e-6b8e-4b54-9771-cb135b0d3e72 req-3ff1da46-773b-4dbf-b9ed-07244adb7639 tempest-ServersTestJSON-1291473095 tempest-ServersTestJSON-1291473095-project-member] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1190.609361] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1190.609450] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.609573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.609645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.609905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.610173] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.610266] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.610340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.610555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.610675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.610775] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.840567] env[65413]: INFO networking_nsxv3.common.synchronization [req-f2779538-a3a6-4593-9015-e854fa3e25c5 req-252bce38-b5ff-4075-8b88-6991cf288b91 tempest-ListServersNegativeTestJSON-257438915 tempest-ListServersNegativeTestJSON-257438915-project-member] Enqueued Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1190.841828] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 with Priority: HIGHEST for action security_group_members [ 1190.842277] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7e128bf-9aa1-47de-ae18-15ee117a8003 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.842368] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.941534] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.050038] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.089261] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: SUCCESS [ 1191.089386] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.089612] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.089885] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.089998] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.113281] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.444336] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.444336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.444336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.444336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.444617] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.444617] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba978295-db66-4f6f-800c-d69ad3fc5fec is going to be updated. [ 1191.475803] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.475957] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.476039] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.476283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.476439] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.486643] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: IN_PROGRESS for 2s [ 1191.552166] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.615470] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.615893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.615893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.615972] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.616103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.616161] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 is going to be deleted. [ 1191.617115] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.677199] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.677406] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.677534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.677731] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.677845] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.677966] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.055309] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.055477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.055540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.055794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.055881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.056025] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 is going to be updated. [ 1192.103517] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.103774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.103873] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.104144] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.104361] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.118353] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: IN_PROGRESS for 2s [ 1192.120063] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.120063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.120063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.120309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.120380] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.120476] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1192.153430] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.153734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.153821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.154060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.154221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.165990] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1193.458976] env[65413]: INFO networking_nsxv3.common.synchronization [req-42257b97-32b5-4b0d-9623-16af548b8b15 req-5ba04537-1d90-4b79-9d59-97595c612822 tempest-ServerAddressesTestJSON-1720970883 tempest-ServerAddressesTestJSON-1720970883-project-member] Enqueued Resource ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf with Priority: HIGHEST for action security_group_members [ 1193.460022] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf with Priority: HIGHEST for action security_group_members [ 1193.460335] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dabc25b-0637-431c-a102-2d70f0ed1abf taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.460415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.460516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.460732] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.460927] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.461056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.461154] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.461344] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.461480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.461647] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dabc25b-0637-431c-a102-2d70f0ed1abf',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.496967] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: SUCCESS [ 1193.497202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.497367] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.497582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.497773] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.499601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.499601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.499601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.499601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.499601] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.499601] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.964022] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.964212] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.964282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.964534] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.964636] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.964844] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.964988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.965059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.965191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.965270] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.965358] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf is going to be updated. [ 1194.001057] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.001057] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.001057] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.001390] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.001538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.002930] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.013385] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf in Status: IN_PROGRESS for 2s [ 1194.128854] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 in Status: SUCCESS [ 1194.129155] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.129418] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.129701] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.129922] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.130069] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.130128] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.130330] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.130419] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.130521] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7e128bf-9aa1-47de-ae18-15ee117a8003',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.178968] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1194.179314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.505871] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba978295-db66-4f6f-800c-d69ad3fc5fec: rpc.has_security_group_logging(os_id): False [ 1194.524478] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.524646] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.524766] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.524995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.525109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.525371] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.525479] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.525542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.525692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.525819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.525881] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba978295-db66-4f6f-800c-d69ad3fc5fec is going to be updated. [ 1194.593970] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.594249] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.594308] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.594554] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.594808] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.607700] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: IN_PROGRESS for 2s [ 1194.633424] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.633672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.633735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.633912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.634010] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.634211] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.634309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.634371] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.634715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.634806] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.634837] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7e128bf-9aa1-47de-ae18-15ee117a8003 is going to be deleted. [ 1194.667916] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.668126] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.668199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.668422] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.668515] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.668615] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7e128bf-9aa1-47de-ae18-15ee117a8003" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.024758] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf in Status: SUCCESS [ 1196.025032] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dabc25b-0637-431c-a102-2d70f0ed1abf deletion is rescheduled due to dependency. [ 1196.025073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dabc25b-0637-431c-a102-2d70f0ed1abf" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.622826] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: SUCCESS [ 1196.623071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.461372] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1198.461646] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1201.607952] env[65413]: INFO networking_nsxv3.common.synchronization [None req-7ff2e88b-816a-4c06-a5cb-decfaecbefdb None None] Enqueued Resource ID: 89eafe96-88d5-43bc-b813-4fc6bb3f40ca with Priority: HIGHEST for action port [ 1201.608487] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89eafe96-88d5-43bc-b813-4fc6bb3f40ca with Priority: HIGHEST for action port [ 1201.608797] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-89eafe96-88d5-43bc-b813-4fc6bb3f40ca taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.608902] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89eafe96-88d5-43bc-b813-4fc6bb3f40ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.608975] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89eafe96-88d5-43bc-b813-4fc6bb3f40ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.610799] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89eafe96-88d5-43bc-b813-4fc6bb3f40ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.610944] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89eafe96-88d5-43bc-b813-4fc6bb3f40ca',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.116625] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 89eafe96-88d5-43bc-b813-4fc6bb3f40ca [ 1202.116625] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.116625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.116625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.116923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.116923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.116923] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:89eafe96-88d5-43bc-b813-4fc6bb3f40ca already deleted. [ 1202.116923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89eafe96-88d5-43bc-b813-4fc6bb3f40ca" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.233723] env[65413]: INFO networking_nsxv3.common.synchronization [None req-78a8aebb-3e86-44d9-94aa-be489e3e17fe tempest-AttachVolumeShelveTestJSON-1305349155 tempest-AttachVolumeShelveTestJSON-1305349155-project-member] Enqueued Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_rules [ 1202.234227] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_rules [ 1202.234547] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3953e04a-df83-4a13-900e-60f4be674a57 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.236865] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.236962] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.237353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.237422] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.333033] env[65413]: INFO networking_nsxv3.common.synchronization [None req-bd41a677-51b6-4307-9fee-e1bb589458e4 tempest-AttachVolumeShelveTestJSON-1305349155 tempest-AttachVolumeShelveTestJSON-1305349155-project-member] Enqueued Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_rules [ 1202.333033] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_rules [ 1202.333561] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3953e04a-df83-4a13-900e-60f4be674a57 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.333684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.762302] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.763312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.763312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.763312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.763312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.763312] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3953e04a-df83-4a13-900e-60f4be674a57 already deleted. [ 1202.763312] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.764447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.764447] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.764505] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.111778] env[65413]: INFO networking_nsxv3.common.synchronization [req-7e173c27-b5c6-4ca4-8fc3-05e29d4fa732 req-66a54993-9036-4c4c-bc68-75ef94506959 tempest-ServersTestJSON-1291473095 tempest-ServersTestJSON-1291473095-project-member] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1203.112413] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1203.112732] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.112942] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.112942] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.113166] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.113328] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.113426] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.113487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.113708] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.113791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.113878] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.285876] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.286081] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.286156] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.286343] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.286444] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.286537] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3953e04a-df83-4a13-900e-60f4be674a57 already deleted. [ 1203.286634] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.513403] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-904 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.513564] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.513737] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.514335] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.514335] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.514559] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.514767] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.515007] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.515197] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.515438] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1203.515597] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1203.515681] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1203.515851] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1203.515983] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1203.516102] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1203.516269] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1203.541714] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1203.542019] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1203.542275] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1203.542863] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-904" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.542863] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-b3c5fea4-4e3f-47ce-818c-286c57eecbb4 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.543097] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-b3c5fea4-4e3f-47ce-818c-286c57eecbb4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.543175] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-b3c5fea4-4e3f-47ce-818c-286c57eecbb4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.543594] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-b3c5fea4-4e3f-47ce-818c-286c57eecbb4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.543808] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3c5fea4-4e3f-47ce-818c-286c57eecbb4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.616466] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.806695] env[65413]: INFO networking_nsxv3.common.synchronization [None req-11f97640-6e13-42b6-87a9-37304501349f None None] Enqueued Resource ID: a39959b0-eecd-4d1c-9d66-6682a31bfdbc with Priority: HIGHEST for action port [ 1203.806695] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a39959b0-eecd-4d1c-9d66-6682a31bfdbc with Priority: HIGHEST for action port [ 1203.807275] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-a39959b0-eecd-4d1c-9d66-6682a31bfdbc taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.807404] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a39959b0-eecd-4d1c-9d66-6682a31bfdbc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.807474] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a39959b0-eecd-4d1c-9d66-6682a31bfdbc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.807735] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a39959b0-eecd-4d1c-9d66-6682a31bfdbc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.807819] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a39959b0-eecd-4d1c-9d66-6682a31bfdbc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.019461] env[65413]: INFO networking_nsxv3.common.synchronization [req-c3bd0086-3b7a-44cd-bf14-a69580be159d req-bf52b44c-bec4-46b7-8fde-73c1598f7633 tempest-ServerActionsTestJSON-1087044681 tempest-ServerActionsTestJSON-1087044681-project-member] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 1204.019976] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGHEST for action security_group_members [ 1204.020292] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.020412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.020477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.020671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.020822] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.020919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.020979] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.021216] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.021301] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.021435] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.046219] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.046488] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.046636] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.046981] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.047180] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.047367] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port b3c5fea4-4e3f-47ce-818c-286c57eecbb4 not found, creating... [ 1204.047798] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.048223] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.048223] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.048463] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.048680] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.049310] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.049310] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.049454] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.050072] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.050072] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.050072] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: b3c5fea4-4e3f-47ce-818c-286c57eecbb4 is going to be created. [ 1204.070306] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.070594] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.070723] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.071051] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.071342] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.071682] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-b3c5fea4-4e3f-47ce-818c-286c57eecbb4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.119408] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.309787] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a39959b0-eecd-4d1c-9d66-6682a31bfdbc [ 1204.310117] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.310298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.310502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.310648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.310767] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.310909] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a39959b0-eecd-4d1c-9d66-6682a31bfdbc already deleted. [ 1204.311059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a39959b0-eecd-4d1c-9d66-6682a31bfdbc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.523351] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.523512] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.523571] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.524227] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.524227] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.524227] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.524476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.524476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.524542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.524696] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.524829] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef is going to be updated. [ 1204.554208] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.554440] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.554500] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.554806] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.554944] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.565194] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: IN_PROGRESS for 2s [ 1204.621881] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.622114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.622114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.622349] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.622425] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.622524] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1204.652885] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.653042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.653042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.653286] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.653432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.666149] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1204.802315] env[65413]: INFO networking_nsxv3.common.synchronization [req-7e173c27-b5c6-4ca4-8fc3-05e29d4fa732 req-55657ee1-b50b-4d98-b8cc-d48b3b954880 service nova] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_rules [ 1204.802488] env[65413]: INFO networking_nsxv3.common.synchronization [req-7e173c27-b5c6-4ca4-8fc3-05e29d4fa732 req-55657ee1-b50b-4d98-b8cc-d48b3b954880 service nova] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1204.802630] env[65413]: INFO networking_nsxv3.common.synchronization [req-7e173c27-b5c6-4ca4-8fc3-05e29d4fa732 req-55657ee1-b50b-4d98-b8cc-d48b3b954880 service nova] Enqueued Resource ID: b3c5fea4-4e3f-47ce-818c-286c57eecbb4 with Priority: HIGHEST for action port [ 1204.803623] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_rules [ 1204.803623] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1204.803623] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3c5fea4-4e3f-47ce-818c-286c57eecbb4 with Priority: HIGHEST for action port [ 1204.803770] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.803770] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.803893] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.804174] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.804282] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.805199] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.805597] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.805845] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3c5fea4-4e3f-47ce-818c-286c57eecbb4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.805988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3c5fea4-4e3f-47ce-818c-286c57eecbb4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.806095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3c5fea4-4e3f-47ce-818c-286c57eecbb4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.806302] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3c5fea4-4e3f-47ce-818c-286c57eecbb4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.806412] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3c5fea4-4e3f-47ce-818c-286c57eecbb4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.308905] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.308905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.309411] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3c5fea4-4e3f-47ce-818c-286c57eecbb4 with status ACTIVE [ 1205.309411] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.309505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.309505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.309700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.309803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.310034] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.310191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.310191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.310328] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.310415] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.310590] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.310681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.310710] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.310870] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.310901] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.311084] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3c5fea4-4e3f-47ce-818c-286c57eecbb4 is going to be updated. [ 1205.338482] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.338663] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.338705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.338898] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.339044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.339200] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3c5fea4-4e3f-47ce-818c-286c57eecbb4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.576016] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d31c425c-609d-448d-bad8-0a938d0bf8ef in Status: SUCCESS [ 1206.576409] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef deletion is rescheduled due to dependency. [ 1206.576478] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.677824] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1206.678071] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.678256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.678505] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.678714] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.678836] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.678902] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.679098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.679180] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.679287] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.181592] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.684146] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.187156] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.187362] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.187362] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.187788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.187788] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.187966] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1208.219404] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.219655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.219655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.219894] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.220113] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.230369] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1209.804322] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1209.804828] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1210.242544] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 4s [ 1210.441877] env[65413]: INFO networking_nsxv3.common.synchronization [req-418f66cc-276a-4336-ae02-9ca4ec344482 req-0c7766cf-f257-4d48-b0ce-9092ee2db342 tempest-AttachVolumeShelveTestJSON-1305349155 tempest-AttachVolumeShelveTestJSON-1305349155-project-member] Enqueued Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_members [ 1210.442415] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_members [ 1210.442722] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3953e04a-df83-4a13-900e-60f4be674a57 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.442837] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.442941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.443284] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.443451] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.443589] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.443631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.443792] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.443877] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.443969] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.801051] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.801295] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.801459] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.801914] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.802340] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.802600] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.802805] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.803158] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.803392] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.803945] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1210.803945] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1210.804144] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1210.804346] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1210.804581] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1210.804720] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1210.804943] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1210.825669] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1210.825846] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1210.826015] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1210.826244] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.826659] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-9e596173-c205-4956-8571-e385844c77b4 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.826846] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.827062] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.827422] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.827560] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e596173-c205-4956-8571-e385844c77b4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.945744] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.945974] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.945974] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.946207] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.946300] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.946510] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.946619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.946681] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.946931] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.947084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.947230] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3953e04a-df83-4a13-900e-60f4be674a57 already deleted. [ 1210.947373] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.330469] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.330736] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.330862] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.331199] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.331369] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.331530] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 9e596173-c205-4956-8571-e385844c77b4 not found, creating... [ 1211.331864] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.332093] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.332224] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.332501] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.332759] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.333131] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.333315] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.333464] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.333758] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.333923] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.334083] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 9e596173-c205-4956-8571-e385844c77b4 is going to be created. [ 1211.360522] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.360760] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.360874] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.361233] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.361651] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.361899] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.040401] env[65413]: INFO networking_nsxv3.common.synchronization [req-418f66cc-276a-4336-ae02-9ca4ec344482 req-4596eb54-6226-4c9b-9f5a-bfc7fb8112c3 service nova] Enqueued Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_rules [ 1212.040730] env[65413]: INFO networking_nsxv3.common.synchronization [req-418f66cc-276a-4336-ae02-9ca4ec344482 req-4596eb54-6226-4c9b-9f5a-bfc7fb8112c3 service nova] Enqueued Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_members [ 1212.040730] env[65413]: INFO networking_nsxv3.common.synchronization [req-418f66cc-276a-4336-ae02-9ca4ec344482 req-4596eb54-6226-4c9b-9f5a-bfc7fb8112c3 service nova] Enqueued Resource ID: 9e596173-c205-4956-8571-e385844c77b4 with Priority: HIGHEST for action port [ 1212.041247] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_rules [ 1212.041383] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_members [ 1212.041481] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e596173-c205-4956-8571-e385844c77b4 with Priority: HIGHEST for action port [ 1212.041750] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3953e04a-df83-4a13-900e-60f4be674a57 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.041872] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.041971] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.042369] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.042489] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.044325] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3953e04a-df83-4a13-900e-60f4be674a57 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.044325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.044325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.044654] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.045099] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.045099] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.045099] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.045635] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.045635] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.045635] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.047220] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e596173-c205-4956-8571-e385844c77b4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.047451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.047545] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.047716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.047817] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e596173-c205-4956-8571-e385844c77b4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.252766] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1212.253037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.253183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.253462] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.253695] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.253812] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.253886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.254051] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.254134] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.254219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.254219] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.545041] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3953e04a-df83-4a13-900e-60f4be674a57 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.545234] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.547535] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.550660] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e596173-c205-4956-8571-e385844c77b4 with status ACTIVE [ 1212.550660] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.550660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.550660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.550660] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.550973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.550973] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.550973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.551091] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.551309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.551309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.551432] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.551630] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.551683] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.551832] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.551946] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.551990] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e596173-c205-4956-8571-e385844c77b4 is going to be updated. [ 1212.574314] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.574523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.574523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.574746] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.574891] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.575061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.757249] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.757416] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.757584] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.757821] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.757995] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.758116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.759024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.759024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.759024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.759024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.759024] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.759024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.759024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.759024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.759575] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.759575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.759575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.759575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.759708] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.759708] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.759772] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.049438] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.262525] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c4cbecb-5529-4a33-ade6-6d4e0203047a: rpc.has_security_group_logging(os_id): False [ 1213.284291] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.284439] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.284490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.284759] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.284857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.285221] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.285221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.285362] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.285403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.285529] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.285651] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.286021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.286021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.286021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.286277] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.286277] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.286364] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.286396] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.286533] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.286611] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.286691] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1213.362815] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.362815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.362815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.362815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.362815] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.382893] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1213.552644] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.552803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.552871] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.553168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.553259] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.553359] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3953e04a-df83-4a13-900e-60f4be674a57 is going to be created. [ 1213.583683] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.583912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.583912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.586496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.586680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.600713] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3953e04a-df83-4a13-900e-60f4be674a57 in Status: UNINITIALIZED for 2s [ 1215.399218] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1215.399559] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.610471] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3953e04a-df83-4a13-900e-60f4be674a57 in Status: SUCCESS [ 1215.610720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.610896] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.611260] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.611458] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.611576] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.611653] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.611823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.611905] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.611992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.612100] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.115265] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.618398] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3953e04a-df83-4a13-900e-60f4be674a57: rpc.has_security_group_logging(os_id): False [ 1216.638418] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.638555] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.638645] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.638971] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.638971] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.639624] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.639624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.639624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.639624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.639624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.639975] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3953e04a-df83-4a13-900e-60f4be674a57 is going to be created. [ 1216.714094] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.714416] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.714507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.714677] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.714863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.731415] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3953e04a-df83-4a13-900e-60f4be674a57 in Status: IN_PROGRESS for 2s [ 1217.042432] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1217.042604] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1218.745786] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3953e04a-df83-4a13-900e-60f4be674a57 in Status: SUCCESS [ 1218.746215] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.768083] env[65413]: INFO networking_nsxv3.common.synchronization [req-f26d8809-f820-4a63-80a7-ef044ade9514 req-c8e8c22e-5a47-4beb-95fc-a17829a9ef21 tempest-ServersTestJSON-1291473095 tempest-ServersTestJSON-1291473095-project-member] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1218.768676] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1218.768988] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.769132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.769199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.769401] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.769554] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.769653] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.769716] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.770275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.770275] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.770275] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.272380] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.775731] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.279308] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.279459] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.279504] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.279817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.279817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.279954] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1220.311910] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.312132] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.312231] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.312629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.312629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.323405] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1222.335682] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1222.335985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.769442] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1223.770046] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1225.282537] env[65413]: INFO networking_nsxv3.common.synchronization [req-8da7bcbe-ffd5-4bd5-916e-f91faf72b639 req-e96767a8-ada1-4cc3-bf64-86d4d1b122f0 tempest-ServersTestJSON-1291473095 tempest-ServersTestJSON-1291473095-project-member] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1225.282821] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGHEST for action security_group_members [ 1225.283138] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.283258] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.283325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.283985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.283985] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.283985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.283985] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.284186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.284186] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.284245] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.787443] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.787632] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.787684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.787885] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.787973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.788174] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.788273] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.788334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.788481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.788553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.788635] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be updated. [ 1225.824428] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.824578] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.824648] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.824868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.825013] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.835251] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: IN_PROGRESS for 2s [ 1226.983265] env[65413]: INFO networking_nsxv3.common.synchronization [req-0bd5f2a4-2c65-46d2-b20a-3622cf2b62bf req-fdbf77d0-543b-4364-9aa1-521f826e8859 tempest-AttachVolumeTestJSON-893762802 tempest-AttachVolumeTestJSON-893762802-project-member] Enqueued Resource ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea with Priority: HIGHEST for action security_group_members [ 1226.983957] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea with Priority: HIGHEST for action security_group_members [ 1226.984374] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-7af49b3e-c32d-4c08-b110-379fb74e2bea taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.984550] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.984619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.985680] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.985866] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.985984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.986069] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.986233] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.986325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.986416] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7af49b3e-c32d-4c08-b110-379fb74e2bea',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.490168] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.490168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.490168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.490168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.490168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.490168] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.490168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.490168] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.490562] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.490562] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.490562] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea is going to be updated. [ 1227.525043] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.525269] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.525410] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.525655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.525872] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.535487] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea in Status: IN_PROGRESS for 2s [ 1227.845462] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a in Status: SUCCESS [ 1227.845714] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a deletion is rescheduled due to dependency. [ 1227.845842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.547047] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea in Status: SUCCESS [ 1229.547413] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7af49b3e-c32d-4c08-b110-379fb74e2bea deletion is rescheduled due to dependency. [ 1229.547413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7af49b3e-c32d-4c08-b110-379fb74e2bea" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.985463] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1231.985791] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1235.712518] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-868 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.712861] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.712861] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.713126] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.713381] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.713537] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.713651] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.713918] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.714227] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.714462] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1235.714575] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1235.714682] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1235.714821] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1235.714939] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1235.715066] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1235.715599] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1235.740666] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1235.740845] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1235.740981] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1235.741180] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-868" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.741557] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.741745] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.741871] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.742164] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.742300] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f28dd771-4673-4f4e-a1ad-93bfd5ca4b86',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.245630] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.245910] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.246062] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.246408] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.246560] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.246861] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.247090] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.247235] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.247490] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.247689] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.248079] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.248302] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.248494] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.248819] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.248981] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.249183] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: f28dd771-4673-4f4e-a1ad-93bfd5ca4b86 is going to be updated. [ 1236.272196] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.272571] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.272728] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.273075] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.273290] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.273723] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.947218] env[65413]: INFO networking_nsxv3.common.synchronization [req-33ce61e3-00db-4dbd-b400-ac941b21f241 req-3d49213f-77d3-45d7-96b2-85b66ada8f74 service nova] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_rules [ 1236.947485] env[65413]: INFO networking_nsxv3.common.synchronization [req-33ce61e3-00db-4dbd-b400-ac941b21f241 req-3d49213f-77d3-45d7-96b2-85b66ada8f74 service nova] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1236.947609] env[65413]: INFO networking_nsxv3.common.synchronization [req-33ce61e3-00db-4dbd-b400-ac941b21f241 req-3d49213f-77d3-45d7-96b2-85b66ada8f74 service nova] Enqueued Resource ID: f28dd771-4673-4f4e-a1ad-93bfd5ca4b86 with Priority: HIGHEST for action port [ 1236.948079] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_rules [ 1236.948227] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1236.948356] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f28dd771-4673-4f4e-a1ad-93bfd5ca4b86 with Priority: HIGHEST for action port [ 1236.948961] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.949099] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.949173] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.949365] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.949432] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.950709] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.950776] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.950830] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.951068] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.952023] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.952023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.952023] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.952547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.952547] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.952547] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.954987] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.954987] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.954987] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.954987] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.955206] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f28dd771-4673-4f4e-a1ad-93bfd5ca4b86',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.455664] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.458784] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.458937] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.459139] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f28dd771-4673-4f4e-a1ad-93bfd5ca4b86 with status ACTIVE [ 1237.459314] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.459423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.459507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.459693] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.459778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.459951] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.460060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.460121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.460272] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.460351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.460518] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.460609] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.460669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.460808] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.460881] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.460963] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f28dd771-4673-4f4e-a1ad-93bfd5ca4b86 is going to be updated. [ 1237.482736] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.482960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.482960] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.483155] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.483285] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.483432] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f28dd771-4673-4f4e-a1ad-93bfd5ca4b86" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.958164] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.460839] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.461066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.461066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.461291] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.461377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.461474] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded is going to be updated. [ 1238.492904] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.493143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.493143] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.493338] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.493480] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.506065] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: IN_PROGRESS for 2s [ 1240.517031] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: SUCCESS [ 1240.517031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.517031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.517483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.517483] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.517483] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.517600] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.517705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.517749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.517856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.517927] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.020102] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.522698] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f4aeeb11-908b-4980-9ebd-3c96e2724ded: rpc.has_security_group_logging(os_id): False [ 1241.543200] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.543489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.543489] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.543633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.543721] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.544030] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.544163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.544228] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.544354] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.544460] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.544552] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded is going to be updated. [ 1241.643344] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.643623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.643623] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.643785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.643961] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.661365] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: IN_PROGRESS for 2s [ 1241.949470] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1241.949660] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1243.680787] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: SUCCESS [ 1243.681120] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.793596] env[65413]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1246.793951] env[65413]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1246.951187] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1246.951302] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1251.952713] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1251.953125] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1253.076757] env[65413]: INFO networking_nsxv3.common.synchronization [req-996020c5-47ca-4f83-9578-673dbf66dfd9 req-03b05d8e-0942-4d05-9afa-aba54f1e6396 tempest-ServerActionsTestOtherB-69504015 tempest-ServerActionsTestOtherB-69504015-project-member] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1253.077329] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGHEST for action security_group_members [ 1253.077642] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.077778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.077867] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.078075] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.078241] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.078356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.078412] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.078582] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.078677] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.078768] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.584658] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.584904] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.584904] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.585114] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.585274] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.585508] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.585642] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.585726] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.585924] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.586040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.586157] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded is going to be updated. [ 1253.616604] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.616842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.616842] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.617066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.617283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.626896] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: IN_PROGRESS for 2s [ 1255.645141] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded in Status: SUCCESS [ 1255.645574] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded deletion is rescheduled due to dependency. [ 1255.645574] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.078392] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1258.078799] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1258.639942] env[65413]: INFO networking_nsxv3.common.synchronization [req-5b8a2ddc-96df-4501-9093-56869b6c93ac req-b05742e2-b2a7-4f11-9094-1e846db08e93 tempest-ServerActionsTestOtherA-276981019 tempest-ServerActionsTestOtherA-276981019-project-member] Enqueued Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_members [ 1258.640120] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_members [ 1258.640435] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba978295-db66-4f6f-800c-d69ad3fc5fec taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.640552] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.640619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.640819] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.640970] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.641077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.641136] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.641278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.641357] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.641446] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.144306] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.646360] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.149489] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.149923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.149923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.149923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.150059] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.150120] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba978295-db66-4f6f-800c-d69ad3fc5fec is going to be updated. [ 1260.180806] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.181033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.181033] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.181229] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.181370] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.190239] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: IN_PROGRESS for 2s [ 1262.201210] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: SUCCESS [ 1262.201577] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.641113] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1263.641113] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1264.994328] env[65413]: INFO networking_nsxv3.common.synchronization [None req-d0529ed2-16b3-4867-aa4b-d05234a300ff None None] Enqueued Resource ID: 1cb03f00-b071-407a-9821-56d78cf016b3 with Priority: HIGHEST for action port [ 1264.994853] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1cb03f00-b071-407a-9821-56d78cf016b3 with Priority: HIGHEST for action port [ 1264.995207] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-1cb03f00-b071-407a-9821-56d78cf016b3 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.995342] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1cb03f00-b071-407a-9821-56d78cf016b3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.995393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1cb03f00-b071-407a-9821-56d78cf016b3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.995699] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1cb03f00-b071-407a-9821-56d78cf016b3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.996708] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1cb03f00-b071-407a-9821-56d78cf016b3',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.499580] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1cb03f00-b071-407a-9821-56d78cf016b3 [ 1265.499580] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.499580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.499580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.499580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.499580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.499580] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1cb03f00-b071-407a-9821-56d78cf016b3 already deleted. [ 1265.499580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1cb03f00-b071-407a-9821-56d78cf016b3" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.075438] env[65413]: INFO networking_nsxv3.common.synchronization [None req-1be683c9-3928-43df-8dda-725a3d95d1f9 None None] Enqueued Resource ID: 7f806a5d-100b-4828-9ebe-b74f0149a66b with Priority: HIGHEST for action port [ 1269.075684] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f806a5d-100b-4828-9ebe-b74f0149a66b with Priority: HIGHEST for action port [ 1269.076374] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f806a5d-100b-4828-9ebe-b74f0149a66b taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.076374] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f806a5d-100b-4828-9ebe-b74f0149a66b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.076494] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f806a5d-100b-4828-9ebe-b74f0149a66b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.076699] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f806a5d-100b-4828-9ebe-b74f0149a66b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.076782] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f806a5d-100b-4828-9ebe-b74f0149a66b',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.581034] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7f806a5d-100b-4828-9ebe-b74f0149a66b [ 1269.581034] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.581034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.581034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.581263] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.581263] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.581325] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7f806a5d-100b-4828-9ebe-b74f0149a66b already deleted. [ 1269.581413] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f806a5d-100b-4828-9ebe-b74f0149a66b" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.341452] env[65413]: INFO networking_nsxv3.common.synchronization [None req-84bfd09c-95d6-41ee-b223-a1b94c0127e8 None None] Enqueued Resource ID: 8f800858-b323-45e5-91d6-4d65d84ce7d8 with Priority: HIGHEST for action port [ 1271.342013] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8f800858-b323-45e5-91d6-4d65d84ce7d8 with Priority: HIGHEST for action port [ 1271.342363] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-8f800858-b323-45e5-91d6-4d65d84ce7d8 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.342491] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8f800858-b323-45e5-91d6-4d65d84ce7d8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.342560] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8f800858-b323-45e5-91d6-4d65d84ce7d8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.342810] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8f800858-b323-45e5-91d6-4d65d84ce7d8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.342892] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8f800858-b323-45e5-91d6-4d65d84ce7d8',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.844624] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8f800858-b323-45e5-91d6-4d65d84ce7d8 [ 1271.844974] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.845288] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.845362] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.845592] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.845682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.845780] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8f800858-b323-45e5-91d6-4d65d84ce7d8 already deleted. [ 1271.845883] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8f800858-b323-45e5-91d6-4d65d84ce7d8" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.471889] env[65413]: INFO networking_nsxv3.common.synchronization [req-781f7c5f-eb07-4f1c-a98c-711a48918671 req-483b663c-61b4-4bf1-96cb-74100bfe976d tempest-ServerMetadataTestJSON-412065020 tempest-ServerMetadataTestJSON-412065020-project-member] Enqueued Resource ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 with Priority: HIGHEST for action security_group_members [ 1274.472525] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 with Priority: HIGHEST for action security_group_members [ 1274.472840] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7666cb4-6d10-4060-9c17-8e0b18240e50 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.472973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.473060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.473487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.473487] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.473629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.473629] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.473803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.473885] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.473967] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7666cb4-6d10-4060-9c17-8e0b18240e50',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.775181] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-368 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.775508] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-368" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.775696] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-368" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.776215] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-368" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.776626] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.776857] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.777056] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.777415] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.777645] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.777964] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.778167] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1274.778348] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1274.778524] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1274.778710] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1274.778883] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1274.779105] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1274.802504] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1274.802698] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1274.802793] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1274.802971] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-368" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.803310] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-55830f60-78ae-4611-8383-2de7ae52ae9c taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.803485] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-55830f60-78ae-4611-8383-2de7ae52ae9c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.803602] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-55830f60-78ae-4611-8383-2de7ae52ae9c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.803972] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-55830f60-78ae-4611-8383-2de7ae52ae9c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.804190] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55830f60-78ae-4611-8383-2de7ae52ae9c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.976991] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.977159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.977236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.977452] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.977538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.977730] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.977826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.977888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.978053] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.978128] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.978213] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 already deleted. [ 1274.978292] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.306422] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.306665] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.306901] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.307369] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.307620] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.307856] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Segment Port 55830f60-78ae-4611-8383-2de7ae52ae9c not found, creating... [ 1275.308196] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.308391] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.308527] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.308784] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.308935] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.309265] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.309453] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.309604] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.309838] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.309994] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.310173] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 55830f60-78ae-4611-8383-2de7ae52ae9c is going to be created. [ 1275.331464] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.331697] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.331823] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.332184] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.332435] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.332657] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-55830f60-78ae-4611-8383-2de7ae52ae9c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.006794] env[65413]: INFO networking_nsxv3.common.synchronization [req-781f7c5f-eb07-4f1c-a98c-711a48918671 req-e21619cf-0364-4fdd-83fe-697925f73739 service nova] Enqueued Resource ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 with Priority: HIGHEST for action security_group_rules [ 1276.006794] env[65413]: INFO networking_nsxv3.common.synchronization [req-781f7c5f-eb07-4f1c-a98c-711a48918671 req-e21619cf-0364-4fdd-83fe-697925f73739 service nova] Enqueued Resource ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 with Priority: HIGHEST for action security_group_members [ 1276.007094] env[65413]: INFO networking_nsxv3.common.synchronization [req-781f7c5f-eb07-4f1c-a98c-711a48918671 req-e21619cf-0364-4fdd-83fe-697925f73739 service nova] Enqueued Resource ID: 55830f60-78ae-4611-8383-2de7ae52ae9c with Priority: HIGHEST for action port [ 1276.007479] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 with Priority: HIGHEST for action security_group_rules [ 1276.007634] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 with Priority: HIGHEST for action security_group_members [ 1276.007732] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55830f60-78ae-4611-8383-2de7ae52ae9c with Priority: HIGHEST for action port [ 1276.008017] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7666cb4-6d10-4060-9c17-8e0b18240e50 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.008169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.008238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.008496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.008579] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7666cb4-6d10-4060-9c17-8e0b18240e50',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.009480] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7666cb4-6d10-4060-9c17-8e0b18240e50 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.009802] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.009802] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.010021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.010021] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.010112] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.010160] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.010300] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.010381] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.010477] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7666cb4-6d10-4060-9c17-8e0b18240e50',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.012701] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-55830f60-78ae-4611-8383-2de7ae52ae9c taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.012809] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-55830f60-78ae-4611-8383-2de7ae52ae9c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.012880] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-55830f60-78ae-4611-8383-2de7ae52ae9c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.013037] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-55830f60-78ae-4611-8383-2de7ae52ae9c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.013109] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('55830f60-78ae-4611-8383-2de7ae52ae9c',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.391793] env[65413]: INFO networking_nsxv3.common.synchronization [req-0c03d128-3ba3-47d7-8b33-6c6b13033805 req-9d532f1a-2e92-4398-9106-bed11f2aef98 tempest-ServerActionsTestOtherA-276981019 tempest-ServerActionsTestOtherA-276981019-project-member] Enqueued Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_members [ 1276.392568] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGHEST for action security_group_members [ 1276.394741] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba978295-db66-4f6f-800c-d69ad3fc5fec taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.394741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.394741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.394741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.394741] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.394741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.394741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.394741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.394741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.394741] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.515247] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7666cb4-6d10-4060-9c17-8e0b18240e50 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.515400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.515597] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d7666cb4-6d10-4060-9c17-8e0b18240e50',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.516499] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 55830f60-78ae-4611-8383-2de7ae52ae9c with status ACTIVE [ 1276.516684] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.516820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.516898] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.517066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.517153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.517334] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.517423] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.517473] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.517637] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.517698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.517878] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.517984] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.518034] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.518351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.518351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.518351] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 55830f60-78ae-4611-8383-2de7ae52ae9c is going to be updated. [ 1276.541826] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.542218] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.542218] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.542218] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.542387] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.542487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-55830f60-78ae-4611-8383-2de7ae52ae9c" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.896179] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.896387] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.896434] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.896633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.896720] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.896910] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.897020] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.897078] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.897219] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.897316] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.897404] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba978295-db66-4f6f-800c-d69ad3fc5fec is going to be updated. [ 1276.925145] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.925317] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.925362] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.925553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.925691] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.934460] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: IN_PROGRESS for 2s [ 1277.020702] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d7666cb4-6d10-4060-9c17-8e0b18240e50',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.523269] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.523430] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.523502] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.523737] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.523820] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.523918] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 is going to be created. [ 1277.550031] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.550031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.550031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.550031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.550403] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.562451] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 in Status: UNINITIALIZED for 2s [ 1278.943552] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba978295-db66-4f6f-800c-d69ad3fc5fec in Status: SUCCESS [ 1278.943888] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba978295-db66-4f6f-800c-d69ad3fc5fec deletion is rescheduled due to dependency. [ 1278.943888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.572058] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 in Status: SUCCESS [ 1279.572316] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.572476] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.572706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.572907] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.573022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.573084] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.573243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.573324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.573428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.573497] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d7666cb4-6d10-4060-9c17-8e0b18240e50',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.076504] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7666cb4-6d10-4060-9c17-8e0b18240e50 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.076863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.076863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.077062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.077247] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.077356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.077420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.077619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.077705] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.077794] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.077941] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7666cb4-6d10-4060-9c17-8e0b18240e50 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.078047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.078109] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.078268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.078437] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.078531] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.078591] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.078731] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.078804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.078882] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.078992] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d7666cb4-6d10-4060-9c17-8e0b18240e50',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.581981] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d7666cb4-6d10-4060-9c17-8e0b18240e50: rpc.has_security_group_logging(os_id): False [ 1280.599763] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.599930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.599930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.600165] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.600259] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.600484] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.600595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.600659] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.600976] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.600976] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.601101] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.601181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.601234] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.601613] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.601613] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.601708] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.601708] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.601824] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.601923] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.602044] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.602133] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 is going to be created. [ 1280.658354] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.658463] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.658504] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.658791] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.658994] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.672665] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 in Status: IN_PROGRESS for 2s [ 1281.394106] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1281.394480] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1282.686648] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 in Status: SUCCESS [ 1282.687097] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.395410] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1286.395759] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1286.516388] env[65413]: INFO networking_nsxv3.common.synchronization [req-253db73e-9a3b-4f09-8a6a-3fb07b3e5c96 req-7cf3b147-848e-4d60-9bb7-b0da5c87c1de tempest-ServerMetadataTestJSON-412065020 tempest-ServerMetadataTestJSON-412065020-project-member] Enqueued Resource ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 with Priority: HIGHEST for action security_group_members [ 1286.516820] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 with Priority: HIGHEST for action security_group_members [ 1286.517267] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-d7666cb4-6d10-4060-9c17-8e0b18240e50 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.517398] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.517469] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.517750] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.517979] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.518164] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.518279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.518507] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.518599] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.518693] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d7666cb4-6d10-4060-9c17-8e0b18240e50',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.021466] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.021687] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.021687] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.021907] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.022015] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.022262] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.022375] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.022429] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.022588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.022665] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.022750] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 is going to be updated. [ 1287.055634] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.055857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.055857] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.056062] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.056202] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.073148] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 in Status: IN_PROGRESS for 2s [ 1289.085245] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 in Status: SUCCESS [ 1289.085714] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 deletion is rescheduled due to dependency. [ 1289.085714] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.518481] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1291.518919] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1294.088178] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.088561] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.088561] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.088765] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.089161] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.089360] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.089481] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.089714] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.089847] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.090080] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1294.090194] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1294.090299] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1294.090404] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1294.090511] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1294.090613] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1294.090739] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1294.113899] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1294.114241] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1294.114396] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1294.114571] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.114886] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-9e596173-c205-4956-8571-e385844c77b4 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.115069] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.115191] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.115496] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.115640] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e596173-c205-4956-8571-e385844c77b4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.618115] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.618378] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.618470] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.618728] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.618878] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.619176] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.619331] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.619450] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.619660] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.619792] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.620078] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.620233] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.620363] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.620573] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.620700] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.620836] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 9e596173-c205-4956-8571-e385844c77b4 is going to be updated. [ 1294.643976] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.644283] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.644404] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.644660] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.644866] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.645099] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.342696] env[65413]: INFO networking_nsxv3.common.synchronization [req-c3155004-b2dc-4b74-800d-825f97ad9567 req-9407c52f-9ccc-450c-a81a-717b75a53a00 service nova] Enqueued Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_rules [ 1295.343016] env[65413]: INFO networking_nsxv3.common.synchronization [req-c3155004-b2dc-4b74-800d-825f97ad9567 req-9407c52f-9ccc-450c-a81a-717b75a53a00 service nova] Enqueued Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_members [ 1295.343016] env[65413]: INFO networking_nsxv3.common.synchronization [req-c3155004-b2dc-4b74-800d-825f97ad9567 req-9407c52f-9ccc-450c-a81a-717b75a53a00 service nova] Enqueued Resource ID: 9e596173-c205-4956-8571-e385844c77b4 with Priority: HIGHEST for action port [ 1295.343486] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_rules [ 1295.343622] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_members [ 1295.344167] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e596173-c205-4956-8571-e385844c77b4 with Priority: HIGHEST for action port [ 1295.344519] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3953e04a-df83-4a13-900e-60f4be674a57 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.344643] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.344725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.344912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.344992] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.345911] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3953e04a-df83-4a13-900e-60f4be674a57 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.345997] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.346067] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.346206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.346349] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.346569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.346569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.346671] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.346734] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.346810] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.347598] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e596173-c205-4956-8571-e385844c77b4 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.347672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.347721] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.348142] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.348142] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e596173-c205-4956-8571-e385844c77b4',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.849709] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3953e04a-df83-4a13-900e-60f4be674a57 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.850035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.850087] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.851121] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9e596173-c205-4956-8571-e385844c77b4 with status ACTIVE [ 1295.851338] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.851481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.851566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.851827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.851943] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.852170] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.853026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.853026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.853026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.853026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.853026] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.853026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.853026] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.853360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.853360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.853360] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9e596173-c205-4956-8571-e385844c77b4 is going to be updated. [ 1295.876887] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1295.877107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1295.877107] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1295.877324] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1295.877464] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1295.877624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e596173-c205-4956-8571-e385844c77b4" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.355624] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.858088] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.858334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.858334] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.858563] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.858658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.858762] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3953e04a-df83-4a13-900e-60f4be674a57 is going to be updated. [ 1296.890821] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.891082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.891082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.891283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.891417] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.900458] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3953e04a-df83-4a13-900e-60f4be674a57 in Status: IN_PROGRESS for 2s [ 1298.911739] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3953e04a-df83-4a13-900e-60f4be674a57 in Status: SUCCESS [ 1298.912169] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.912297] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.912585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.912854] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.912988] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.913118] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.913390] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.913522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.913626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.913734] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.416260] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1299.918902] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3953e04a-df83-4a13-900e-60f4be674a57: rpc.has_security_group_logging(os_id): False [ 1299.937713] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.938060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.938060] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.938369] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.938522] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.938844] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1299.939019] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1299.939122] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1299.939335] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1299.939475] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.939633] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3953e04a-df83-4a13-900e-60f4be674a57 is going to be updated. [ 1300.002234] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1300.002540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1300.002540] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1300.002786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1300.002966] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1300.017437] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3953e04a-df83-4a13-900e-60f4be674a57 in Status: IN_PROGRESS for 2s [ 1300.345209] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1300.345465] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1302.038888] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3953e04a-df83-4a13-900e-60f4be674a57 in Status: SUCCESS [ 1302.039313] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.738991] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.739698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.739698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.739698] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.739698] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.242400] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1304.745120] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.247500] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1305.247731] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1305.346394] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1305.346629] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1306.017028] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.017533] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.017533] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.017533] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.029855] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1306.030653] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.031322] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1306.067291] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.067503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.067503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.067649] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.079146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.079846] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1306.079930] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.080022] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1306.117680] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.117953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.117953] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.118105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.119565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.119733] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1306.193673] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.193919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.193919] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.194095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.194455] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.194737] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1306.275015] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.275238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.275238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.275467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.275774] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.276072] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:43. [ 1306.276166] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'c249e605-e5e9-4e19-9316-502e4084ec60', '3953e04a-df83-4a13-900e-60f4be674a57', 'edbcf595-e502-4812-b097-93b4e6d1355d', '0c4cbecb-5529-4a33-ade6-6d4e0203047a', '579e1066-bea4-4954-a499-fb0ae75b5375', 'ba978295-db66-4f6f-800c-d69ad3fc5fec', 'd31c425c-609d-448d-bad8-0a938d0bf8ef', 'd7666cb4-6d10-4060-9c17-8e0b18240e50', 'af57a10c-d2fd-4a8a-8e67-890fc4b4d689', 'dc6363fa-eea2-4547-9c1c-27fea8439578', 'f4aeeb11-908b-4980-9ebd-3c96e2724ded', 'e66f37bc-ef47-4d76-937b-4d1c38a4ffe7', '065563e4-03b1-4f50-9075-8d4bf2c3fb60', 'b7c727cf-c0c3-4630-a13c-00fc005b9b3a', 'abda67a6-20b2-4d8b-8a37-701a11fb0d75', 'fd87052e-7745-4df2-93d7-5efc42c58438', '2eaf869e-a041-4425-9c95-622578933869', 'bc7b7d78-f994-42d1-964f-0485a67466cc', '7b3bad9e-4f10-4e75-bf3f-69836f779f28', 'c42fa4ec-a6a4-414a-a7fe-8a021fbde28e', '0dabc25b-0637-431c-a102-2d70f0ed1abf', '0022fbcd-322d-4db7-a1a1-6693d137e213', '3d036f63-388f-4a40-b3dc-855ae378cbe3', '185b0179-79b1-4f7f-a796-e81c3eb7726c', '9d35feb8-5ef7-43ac-855e-ecb9d850ee7e', '9b9c29e6-4adf-4695-9f0a-75daeb6daeb9', '8d4b1c1e-e8bd-4ff3-b6e5-628751743e7b', '93ea813f-4897-4022-881c-ff28bf9f5462', '74cdff0a-9c51-4fce-a1ad-6ce2fbbb1100', 'ca89c8be-e3c6-40f6-87a3-7faf3a616f56', '924c9188-b4e7-4597-a445-d583984b729f', '1945c8c9-d5b5-4111-ba8b-cb310537a2d4', 'db5ce1f9-9f0c-41c5-ada2-266b4d1d5dc8', 'd96dd8be-7e0f-4527-b6b4-1fd21b89c256', 'cd34bb24-11b2-4ccc-9316-b0c847939508', '2204e101-51b2-465b-9a7b-c28fa89afdc1', 'd8645530-de9a-4187-9078-4d9ec14cdb6b', '7e429593-1cb3-44b2-8d70-77fbe7afbed5', '58542666-ecc3-4c4c-bed5-143746872487', '62c7b2f4-fd85-43b7-9fd0-ff7a2eeb18d4', '5d92a9ea-1a70-4bff-aac7-578c2d7396f3', '7af49b3e-c32d-4c08-b110-379fb74e2bea', '14ffed21-0b3b-46f2-aece-160a014b9767'} {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.276257] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1306.295386] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.295580] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.295627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.295803] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.296012] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.296012] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1306.296141] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.296141] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1306.380019] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.380222] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.380283] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.380471] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.381688] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.381965] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1306.382054] env[65413]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=65413) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1306.382125] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1306.382211] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1306.382270] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/43 resources of Type:Security Group Rules [ 1306.382333] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGH for action security_group_rules [ 1306.382434] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGH for action security_group_rules [ 1306.382580] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGH for action security_group_rules [ 1306.382580] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGH for action security_group_rules [ 1306.382665] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGH for action security_group_rules [ 1306.382665] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGH for action security_group_rules [ 1306.382734] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGH for action security_group_rules [ 1306.382770] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 with Priority: HIGH for action security_group_rules [ 1306.382828] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 with Priority: HIGH for action security_group_rules [ 1306.382888] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc6363fa-eea2-4547-9c1c-27fea8439578 with Priority: HIGH for action security_group_rules [ 1306.382968] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGH for action security_group_rules [ 1306.383013] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 with Priority: HIGH for action security_group_rules [ 1306.383069] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 with Priority: HIGH for action security_group_rules [ 1306.383127] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGH for action security_group_rules [ 1306.383185] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGH for action security_group_rules [ 1306.383245] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fd87052e-7745-4df2-93d7-5efc42c58438 with Priority: HIGH for action security_group_rules [ 1306.383306] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2eaf869e-a041-4425-9c95-622578933869 with Priority: HIGH for action security_group_rules [ 1306.383436] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bc7b7d78-f994-42d1-964f-0485a67466cc with Priority: HIGH for action security_group_rules [ 1306.383436] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGH for action security_group_rules [ 1306.383537] env[65413]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e with Priority: HIGH for action security_group_rules [ 1306.383575] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.347469] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1310.347469] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1310.348029] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c249e605-e5e9-4e19-9316-502e4084ec60 with Priority: HIGH for action security_group_rules [ 1310.348029] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: edbcf595-e502-4812-b097-93b4e6d1355d with Priority: HIGH for action security_group_rules [ 1310.348029] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d31c425c-609d-448d-bad8-0a938d0bf8ef with Priority: HIGH for action security_group_rules [ 1310.348029] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 with Priority: HIGH for action security_group_rules [ 1310.348029] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e with Priority: HIGH for action security_group_rules [ 1310.348205] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 with Priority: HIGH for action security_group_rules [ 1310.348242] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc7b7d78-f994-42d1-964f-0485a67466cc with Priority: HIGH for action security_group_rules [ 1310.348322] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eaf869e-a041-4425-9c95-622578933869 with Priority: HIGH for action security_group_rules [ 1310.348430] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a with Priority: HIGH for action security_group_rules [ 1310.348520] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd87052e-7745-4df2-93d7-5efc42c58438 with Priority: HIGH for action security_group_rules [ 1310.348609] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 with Priority: HIGH for action security_group_rules [ 1310.348699] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 with Priority: HIGH for action security_group_rules [ 1310.348788] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded with Priority: HIGH for action security_group_rules [ 1310.348874] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc6363fa-eea2-4547-9c1c-27fea8439578 with Priority: HIGH for action security_group_rules [ 1310.348962] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 with Priority: HIGH for action security_group_rules [ 1310.349065] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba978295-db66-4f6f-800c-d69ad3fc5fec with Priority: HIGH for action security_group_rules [ 1310.349163] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 with Priority: HIGH for action security_group_rules [ 1310.349251] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 579e1066-bea4-4954-a499-fb0ae75b5375 with Priority: HIGH for action security_group_rules [ 1310.349339] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGH for action security_group_rules [ 1310.349427] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a with Priority: HIGH for action security_group_rules [ 1310.349838] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c249e605-e5e9-4e19-9316-502e4084ec60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.349983] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.350063] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.350289] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.350376] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c249e605-e5e9-4e19-9316-502e4084ec60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.351739] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-edbcf595-e502-4812-b097-93b4e6d1355d taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.351863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.351930] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.352125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.352211] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('edbcf595-e502-4812-b097-93b4e6d1355d',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.353043] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d31c425c-609d-448d-bad8-0a938d0bf8ef taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.353158] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.353223] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.353379] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.353452] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d31c425c-609d-448d-bad8-0a938d0bf8ef',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.354356] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.354356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.354356] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.354536] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.354625] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('abda67a6-20b2-4d8b-8a37-701a11fb0d75',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.355367] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.355532] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.355602] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.355753] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.355826] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c42fa4ec-a6a4-414a-a7fe-8a021fbde28e',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.356585] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.356682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.356744] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.356898] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.356968] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7b3bad9e-4f10-4e75-bf3f-69836f779f28',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.357680] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bc7b7d78-f994-42d1-964f-0485a67466cc taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.357780] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.357845] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.357993] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.358076] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bc7b7d78-f994-42d1-964f-0485a67466cc',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.358823] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2eaf869e-a041-4425-9c95-622578933869 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.358918] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.358918] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.359073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.359165] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2eaf869e-a041-4425-9c95-622578933869',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.360047] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.360047] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.360194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.360268] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.360315] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b7c727cf-c0c3-4630-a13c-00fc005b9b3a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.360992] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fd87052e-7745-4df2-93d7-5efc42c58438 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.361105] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.361167] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.361332] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.361385] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fd87052e-7745-4df2-93d7-5efc42c58438',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.362061] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.362199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.362243] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.362401] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.362510] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('065563e4-03b1-4f50-9075-8d4bf2c3fb60',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.363152] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.363244] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.363282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.363427] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.363501] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e66f37bc-ef47-4d76-937b-4d1c38a4ffe7',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.364329] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.364438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.364481] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.364633] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.364705] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f4aeeb11-908b-4980-9ebd-3c96e2724ded',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.365442] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc6363fa-eea2-4547-9c1c-27fea8439578 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.365514] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.365546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.366124] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.366124] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc6363fa-eea2-4547-9c1c-27fea8439578',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.366511] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-af57a10c-d2fd-4a8a-8e67-890fc4b4d689 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.366618] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.366703] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.366858] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.366924] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('af57a10c-d2fd-4a8a-8e67-890fc4b4d689',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.367709] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba978295-db66-4f6f-800c-d69ad3fc5fec taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.367889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.367889] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.368095] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.368095] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba978295-db66-4f6f-800c-d69ad3fc5fec',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.368771] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d7666cb4-6d10-4060-9c17-8e0b18240e50 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.368963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.368963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.369121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.369196] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d7666cb4-6d10-4060-9c17-8e0b18240e50',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.369861] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-579e1066-bea4-4954-a499-fb0ae75b5375 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.369980] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.370032] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.370181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.370244] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('579e1066-bea4-4954-a499-fb0ae75b5375',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.372751] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3953e04a-df83-4a13-900e-60f4be674a57 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.373294] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.373294] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.373294] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.373294] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.373947] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.374116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.374116] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.374359] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.374359] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c4cbecb-5529-4a33-ade6-6d4e0203047a',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.405648] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.405807] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.405856] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.406082] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.408401] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.408538] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.409373] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.409504] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.410219] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.410302] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.426280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.426454] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c249e605-e5e9-4e19-9316-502e4084ec60 is going to be deleted. [ 1310.427305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.427526] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.445146] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.445358] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d31c425c-609d-448d-bad8-0a938d0bf8ef is going to be deleted. [ 1310.446282] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.446528] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.467672] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.467879] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c42fa4ec-a6a4-414a-a7fe-8a021fbde28e is going to be deleted. [ 1310.468864] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.469121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.485779] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.486029] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.488954] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.489098] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: abda67a6-20b2-4d8b-8a37-701a11fb0d75 is going to be deleted. [ 1310.489973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.490209] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.490298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.490410] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c249e605-e5e9-4e19-9316-502e4084ec60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.506534] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.506733] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.506733] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.506949] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.507056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.507181] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d31c425c-609d-448d-bad8-0a938d0bf8ef" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.540101] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.540315] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.540315] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.540536] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.540664] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.540806] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c42fa4ec-a6a4-414a-a7fe-8a021fbde28e" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.568981] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.569206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.569206] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.569409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.569569] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.569686] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-abda67a6-20b2-4d8b-8a37-701a11fb0d75" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.887605] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3953e04a-df83-4a13-900e-60f4be674a57 taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.887811] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.887811] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.888024] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.888233] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.888341] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.888408] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.888573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.888655] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.888742] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.888830] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1310.899105] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.899278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.899323] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.899487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.902122] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.902255] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.906942] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.907086] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.909970] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.910098] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.934883] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.935121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.936238] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.936371] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.937368] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.937497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.938520] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.938664] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f4aeeb11-908b-4980-9ebd-3c96e2724ded is going to be deleted. [ 1310.939830] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.940124] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.948423] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.948619] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.949723] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.949850] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.950943] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.951083] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.952062] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.952183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.953224] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.953340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.954127] env[65413]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1310.954652] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.954766] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.955581] env[65413]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1310.956075] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.956195] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.957037] env[65413]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1310.957501] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1310.957624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1310.969461] env[65413]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1310.969941] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.970069] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: edbcf595-e502-4812-b097-93b4e6d1355d is going to be deleted. [ 1310.970932] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.971163] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1310.990055] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.990231] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba978295-db66-4f6f-800c-d69ad3fc5fec is going to be deleted. [ 1310.991092] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1310.991311] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.000652] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.000833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.010407] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.010542] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b7c727cf-c0c3-4630-a13c-00fc005b9b3a is going to be deleted. [ 1311.011475] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.011715] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.036585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.036798] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: af57a10c-d2fd-4a8a-8e67-890fc4b4d689 is going to be deleted. [ 1311.037702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.037961] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.039419] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.039548] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.064988] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.065217] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.076110] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.076280] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc6363fa-eea2-4547-9c1c-27fea8439578 is going to be deleted. [ 1311.077336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.077621] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.094385] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.094594] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.111970] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.112157] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7b3bad9e-4f10-4e75-bf3f-69836f779f28 is going to be deleted. [ 1311.113286] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.113549] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.159785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.159997] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fd87052e-7745-4df2-93d7-5efc42c58438 is going to be deleted. [ 1311.160957] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.161236] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.162703] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.162817] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.182256] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.182467] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.197056] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.197230] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 065563e4-03b1-4f50-9075-8d4bf2c3fb60 is going to be deleted. [ 1311.198214] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.198436] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.241451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.241644] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d7666cb4-6d10-4060-9c17-8e0b18240e50 is going to be deleted. [ 1311.242573] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.242795] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.273577] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.273786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.295553] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.295796] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bc7b7d78-f994-42d1-964f-0485a67466cc is going to be deleted. [ 1311.297281] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.297631] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.390939] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.391371] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.392480] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.394241] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.394402] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e66f37bc-ef47-4d76-937b-4d1c38a4ffe7 is going to be deleted. [ 1311.395309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.395557] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.422090] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.422372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.428767] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.428925] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.430715] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.430827] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.433678] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.433797] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c4cbecb-5529-4a33-ade6-6d4e0203047a is going to be deleted. [ 1311.435065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.435339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.461193] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.461374] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 579e1066-bea4-4954-a499-fb0ae75b5375 is going to be deleted. [ 1311.462266] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.462503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.497697] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.497913] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2eaf869e-a041-4425-9c95-622578933869 is going to be deleted. [ 1311.498830] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.499066] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.499159] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.499290] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f4aeeb11-908b-4980-9ebd-3c96e2724ded" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.499450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.499620] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.499700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.499823] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-edbcf595-e502-4812-b097-93b4e6d1355d" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.500349] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.500523] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.500591] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.500706] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba978295-db66-4f6f-800c-d69ad3fc5fec" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.500834] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.500973] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.501061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.501174] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b7c727cf-c0c3-4630-a13c-00fc005b9b3a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.501305] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.501450] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.501519] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.501624] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-af57a10c-d2fd-4a8a-8e67-890fc4b4d689" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.501748] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.501886] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.501957] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.502077] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc6363fa-eea2-4547-9c1c-27fea8439578" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.502199] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.502363] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.502438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.502542] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fd87052e-7745-4df2-93d7-5efc42c58438" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.502662] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.502796] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.502868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.502971] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7b3bad9e-4f10-4e75-bf3f-69836f779f28" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.503103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.503237] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.503309] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.503420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-065563e4-03b1-4f50-9075-8d4bf2c3fb60" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.503571] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.503711] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.503785] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.503888] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d7666cb4-6d10-4060-9c17-8e0b18240e50" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.504013] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.504153] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.504226] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.504389] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bc7b7d78-f994-42d1-964f-0485a67466cc" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.551117] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.551327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.551327] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.551493] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.551585] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.551700] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e66f37bc-ef47-4d76-937b-4d1c38a4ffe7" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.607474] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.607755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.607755] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.608000] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.608131] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.608252] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-579e1066-bea4-4954-a499-fb0ae75b5375" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.617583] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.617804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.617804] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.618085] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.618183] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.618329] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c4cbecb-5529-4a33-ade6-6d4e0203047a" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.642822] env[65413]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1311.643387] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.643530] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.643599] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.643912] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.643963] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.644135] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2eaf869e-a041-4425-9c95-622578933869" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.897492] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3953e04a-df83-4a13-900e-60f4be674a57: rpc.has_security_group_logging(os_id): False [ 1311.915352] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.915565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.915565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.915789] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.935625] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.935942] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.936080] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.936148] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.936353] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.936438] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.936525] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3953e04a-df83-4a13-900e-60f4be674a57 is going to be updated. [ 1311.997140] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.997377] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.997424] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.997621] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.997801] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.031924] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3953e04a-df83-4a13-900e-60f4be674a57 in Status: IN_PROGRESS for 2s [ 1314.049075] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3953e04a-df83-4a13-900e-60f4be674a57 in Status: SUCCESS [ 1314.049510] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1315.350165] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1315.350565] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1320.351348] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1320.351759] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1325.352913] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1325.353355] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1330.353970] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.353970] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1335.355307] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.355710] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1340.356875] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1340.357305] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1345.358381] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1345.358697] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.359942] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.360378] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1350.966062] env[65413]: INFO networking_nsxv3.common.synchronization [req-15652c06-4cac-44b0-a138-8ef0612e5e5c req-298415a1-bfbf-4021-a8eb-389001a2a834 tempest-AttachVolumeShelveTestJSON-1305349155 tempest-AttachVolumeShelveTestJSON-1305349155-project-member] Enqueued Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_members [ 1350.966601] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3953e04a-df83-4a13-900e-60f4be674a57 with Priority: HIGHEST for action security_group_members [ 1350.966901] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-3953e04a-df83-4a13-900e-60f4be674a57 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.967036] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.967111] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.967298] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.968065] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.968065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.968065] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.968269] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.968303] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.968448] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3953e04a-df83-4a13-900e-60f4be674a57',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1351.470653] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.471221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.471221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.471221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.471221] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.471420] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.471420] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.471512] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.471677] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.471739] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.471795] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3953e04a-df83-4a13-900e-60f4be674a57 is going to be updated. [ 1351.499940] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1351.500238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1351.500238] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1351.500360] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1351.500487] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1351.508774] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3953e04a-df83-4a13-900e-60f4be674a57 in Status: IN_PROGRESS for 2s [ 1353.520127] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3953e04a-df83-4a13-900e-60f4be674a57 in Status: SUCCESS [ 1353.520511] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3953e04a-df83-4a13-900e-60f4be674a57 deletion is rescheduled due to dependency. [ 1353.520511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3953e04a-df83-4a13-900e-60f4be674a57" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.645985] env[65413]: INFO networking_nsxv3.common.synchronization [None req-84c1a843-66fc-47dd-9876-e38dce8dc019 tempest-AttachVolumeShelveTestJSON-1305349155 tempest-AttachVolumeShelveTestJSON-1305349155-project-member] Enqueued Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_rules [ 1355.646514] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_rules [ 1355.646832] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d5f46bc-a102-421f-b2b7-ad40844137df taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.646938] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1355.647022] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1355.647314] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1355.647396] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1355.720841] env[65413]: INFO networking_nsxv3.common.synchronization [None req-b9deceb2-73b5-4a1e-9fa6-fe8134258d7c tempest-AttachVolumeShelveTestJSON-1305349155 tempest-AttachVolumeShelveTestJSON-1305349155-project-member] Enqueued Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_rules [ 1355.721340] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_rules [ 1355.721639] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d5f46bc-a102-421f-b2b7-ad40844137df taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1355.721740] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.168853] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.169076] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.169184] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.169513] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.169658] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.169809] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d5f46bc-a102-421f-b2b7-ad40844137df already deleted. [ 1356.169946] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.170194] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.170428] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.170558] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1356.690466] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1356.690884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1356.690884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1356.690884] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1356.691021] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1356.691110] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d5f46bc-a102-421f-b2b7-ad40844137df already deleted. [ 1356.691225] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.722780] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1360.723104] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1361.716520] env[65413]: INFO networking_nsxv3.common.synchronization [req-521f87af-bbcb-4a60-93ba-101c89ff3efd req-2c058c7d-0e44-4dad-9fc0-fd7b740be457 tempest-AttachVolumeShelveTestJSON-1305349155 tempest-AttachVolumeShelveTestJSON-1305349155-project-member] Enqueued Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_members [ 1361.717019] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_members [ 1361.717327] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5f46bc-a102-421f-b2b7-ad40844137df taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.717451] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.717516] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.717778] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.717935] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.718197] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.718280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.718443] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.718527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.718619] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.995910] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.996278] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.996278] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.996538] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.996798] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.996951] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.997214] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.997703] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.997703] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.997825] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1361.997919] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1361.997991] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1361.998118] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1361.998228] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1361.998329] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1361.998455] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1362.019685] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1362.019903] env[65413]: DEBUG dogpile.cache.region [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1362.020045] env[65413]: DEBUG dogpile.lock [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1362.020175] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.020489] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock port-2db94fa7-72d4-4d51-b1fb-66f52157ed70 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.020661] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.020779] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.021121] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.021261] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2db94fa7-72d4-4d51-b1fb-66f52157ed70',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.221029] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.221279] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.221336] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.221595] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.221686] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.221922] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.222061] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.222127] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.222310] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.222400] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.222502] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5f46bc-a102-421f-b2b7-ad40844137df already deleted. [ 1362.222586] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.524310] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.524541] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.524601] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.524909] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.525070] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.525226] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Segment Port 2db94fa7-72d4-4d51-b1fb-66f52157ed70 not found, creating... [ 1362.525496] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.525655] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.525771] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.525996] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.526146] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.526420] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.526571] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.526685] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.526890] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.527064] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.527208] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Resource: SegmentPort with ID: 2db94fa7-72d4-4d51-b1fb-66f52157ed70 is going to be created. [ 1362.547662] env[65413]: DEBUG networking_nsxv3.common.locking [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.547896] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.547994] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.548272] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.548490] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.548696] env[65413]: DEBUG oslo_concurrency.lockutils [None req-f4dd430a-248b-4673-8470-ad61524c802b None None] Releasing lock "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.239710] env[65413]: INFO networking_nsxv3.common.synchronization [req-521f87af-bbcb-4a60-93ba-101c89ff3efd req-676d16a1-e8ce-426e-bee8-d3c6bf815b8c service nova] Enqueued Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_rules [ 1363.240023] env[65413]: INFO networking_nsxv3.common.synchronization [req-521f87af-bbcb-4a60-93ba-101c89ff3efd req-676d16a1-e8ce-426e-bee8-d3c6bf815b8c service nova] Enqueued Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_members [ 1363.240023] env[65413]: INFO networking_nsxv3.common.synchronization [req-521f87af-bbcb-4a60-93ba-101c89ff3efd req-676d16a1-e8ce-426e-bee8-d3c6bf815b8c service nova] Enqueued Resource ID: 2db94fa7-72d4-4d51-b1fb-66f52157ed70 with Priority: HIGHEST for action port [ 1363.240258] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_rules [ 1363.240381] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_members [ 1363.240474] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db94fa7-72d4-4d51-b1fb-66f52157ed70 with Priority: HIGHEST for action port [ 1363.241069] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d5f46bc-a102-421f-b2b7-ad40844137df taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.241147] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.241226] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.241430] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.241510] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.242321] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5f46bc-a102-421f-b2b7-ad40844137df taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.242431] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.242497] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.242682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.242838] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.242936] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.242998] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.243165] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.243248] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.243341] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.244799] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-2db94fa7-72d4-4d51-b1fb-66f52157ed70 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.244940] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.244990] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.245162] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.245235] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2db94fa7-72d4-4d51-b1fb-66f52157ed70',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.747498] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.748588] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5f46bc-a102-421f-b2b7-ad40844137df taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.748723] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.748874] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2db94fa7-72d4-4d51-b1fb-66f52157ed70 with status ACTIVE [ 1363.749050] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.749185] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.749252] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.749424] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.749509] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.750094] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.750094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.750094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.750094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.750094] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.750351] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.750351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.750351] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.750546] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.750614] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.750701] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2db94fa7-72d4-4d51-b1fb-66f52157ed70 is going to be updated. [ 1363.772098] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.772409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.772409] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.772536] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.772730] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.772840] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.252554] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.755429] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.755692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.755692] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.755833] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.755926] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.756038] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5f46bc-a102-421f-b2b7-ad40844137df is going to be created. [ 1364.780948] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.781191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.781191] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.781394] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.781549] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.790632] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5f46bc-a102-421f-b2b7-ad40844137df in Status: UNINITIALIZED for 2s [ 1366.803767] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5f46bc-a102-421f-b2b7-ad40844137df in Status: SUCCESS [ 1366.804058] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.804178] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.804394] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.804584] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.804702] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.804784] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.804948] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.805040] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.805125] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.805211] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.307826] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.810960] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d5f46bc-a102-421f-b2b7-ad40844137df: rpc.has_security_group_logging(os_id): False [ 1367.829408] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.829627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.829627] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.829826] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.829914] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.830175] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.830278] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.830340] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.830490] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.830565] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.830648] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d5f46bc-a102-421f-b2b7-ad40844137df is going to be created. [ 1367.937250] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.937515] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.937515] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.937684] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.937869] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.959516] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d5f46bc-a102-421f-b2b7-ad40844137df in Status: IN_PROGRESS for 2s [ 1368.241609] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1368.241816] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1369.974395] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d5f46bc-a102-421f-b2b7-ad40844137df in Status: SUCCESS [ 1369.974868] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.242544] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.242939] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1378.243282] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1378.243665] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1383.244142] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.244612] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1388.245643] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1388.245643] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1393.246698] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.247072] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.247489] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.247903] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1403.248249] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.248654] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.249394] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.249785] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.250050] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.250619] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.251402] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.251402] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.252562] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.252976] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.253271] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.253756] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.254626] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.255077] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1435.153405] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.153773] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.153773] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.153992] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.154259] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.154414] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.154528] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.154810] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.154972] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.155347] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1435.155714] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] NeedRegenerationException {{(pid=65413) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1435.155714] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] no value, waiting for create lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1435.155714] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] value creation lock acquired {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1435.155871] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] No value present for key: 'zone-id' {{(pid=65413) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1435.155907] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Calling creation function for not-yet-present value {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1435.156014] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1435.183097] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1435.183289] env[65413]: DEBUG dogpile.cache.region [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=65413) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1435.183405] env[65413]: DEBUG dogpile.lock [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Released creation lock {{(pid=65413) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1435.183570] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "network-458" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.183880] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock port-2db94fa7-72d4-4d51-b1fb-66f52157ed70 taken with stack trace [, , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.184066] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.184186] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.184448] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.184578] env[65413]: DEBUG networking_nsxv3.api.rpc [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2db94fa7-72d4-4d51-b1fb-66f52157ed70',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1435.687752] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.688040] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.688114] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.688397] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.688541] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.688868] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.689056] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.689178] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.689398] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.689587] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.689817] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.689968] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.690097] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.690311] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.690439] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.690578] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Resource: SegmentPort with ID: 2db94fa7-72d4-4d51-b1fb-66f52157ed70 is going to be updated. [ 1435.710959] env[65413]: DEBUG networking_nsxv3.common.locking [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1435.711188] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1435.711276] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1435.711515] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1435.711810] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1435.712051] env[65413]: DEBUG oslo_concurrency.lockutils [None req-c194eddc-cc71-4f8f-a4bc-0de224c1a298 None None] Releasing lock "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.398853] env[65413]: INFO networking_nsxv3.common.synchronization [req-b7396244-0285-4529-8899-6b74dc6668bf req-dc9fea76-0244-49d9-9fbb-60cfb9154330 service nova] Enqueued Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_rules [ 1436.399135] env[65413]: INFO networking_nsxv3.common.synchronization [req-b7396244-0285-4529-8899-6b74dc6668bf req-dc9fea76-0244-49d9-9fbb-60cfb9154330 service nova] Enqueued Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_members [ 1436.399182] env[65413]: INFO networking_nsxv3.common.synchronization [req-b7396244-0285-4529-8899-6b74dc6668bf req-dc9fea76-0244-49d9-9fbb-60cfb9154330 service nova] Enqueued Resource ID: 2db94fa7-72d4-4d51-b1fb-66f52157ed70 with Priority: HIGHEST for action port [ 1436.399410] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_rules [ 1436.399553] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_members [ 1436.399648] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2db94fa7-72d4-4d51-b1fb-66f52157ed70 with Priority: HIGHEST for action port [ 1436.400205] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8d5f46bc-a102-421f-b2b7-ad40844137df taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.400325] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.400393] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.400626] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.400662] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.401947] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5f46bc-a102-421f-b2b7-ad40844137df taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.401947] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.402069] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.402179] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.402322] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.403031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.403031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.403031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.403031] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.403031] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.403624] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock port-2db94fa7-72d4-4d51-b1fb-66f52157ed70 taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.403761] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.403800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.404008] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.404100] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2db94fa7-72d4-4d51-b1fb-66f52157ed70',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.905532] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.906646] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5f46bc-a102-421f-b2b7-ad40844137df taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.906749] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.906903] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2db94fa7-72d4-4d51-b1fb-66f52157ed70 with status ACTIVE [ 1436.907063] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.907177] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.907245] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.907477] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.907568] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.907741] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.907741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.907741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.907741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.907741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.907741] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.907741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.907741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.907741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.907741] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.907741] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2db94fa7-72d4-4d51-b1fb-66f52157ed70 is going to be updated. [ 1436.930035] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.930035] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.930372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.930372] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.930496] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.930675] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2db94fa7-72d4-4d51-b1fb-66f52157ed70" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.411449] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1437.914294] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.914527] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.914588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.914887] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.915073] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.915238] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5f46bc-a102-421f-b2b7-ad40844137df is going to be updated. [ 1437.945732] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1437.946042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1437.946042] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1437.946240] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1437.946399] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1437.956056] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5f46bc-a102-421f-b2b7-ad40844137df in Status: IN_PROGRESS for 2s [ 1439.967716] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5f46bc-a102-421f-b2b7-ad40844137df in Status: SUCCESS [ 1439.968129] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.968208] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.968460] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.968693] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1439.968834] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1439.968957] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1439.969119] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1439.969234] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.969339] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1439.969457] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.472775] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.974924] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8d5f46bc-a102-421f-b2b7-ad40844137df: rpc.has_security_group_logging(os_id): False [ 1440.994531] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.994839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.994839] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.994995] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.995103] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.995374] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.995503] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.995566] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.995725] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.995800] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.995883] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8d5f46bc-a102-421f-b2b7-ad40844137df is going to be updated. [ 1441.057651] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.057897] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.057897] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.058121] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.058280] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.074704] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d5f46bc-a102-421f-b2b7-ad40844137df in Status: IN_PROGRESS for 2s [ 1441.400783] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1441.400999] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1443.247391] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8d5f46bc-a102-421f-b2b7-ad40844137df in Status: SUCCESS [ 1443.247844] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.402552] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1446.402552] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1451.403394] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1451.403776] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1456.404594] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1456.404594] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1461.405535] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1461.405535] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1466.406913] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1466.406913] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1471.408339] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1471.408745] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1476.409136] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1476.409589] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1481.410334] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1481.410597] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.411621] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1486.411621] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1486.794864] env[65413]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1486.795131] env[65413]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-9185ea2b-dcba-4407-aae0-411c53c86987 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1487.421084] env[65413]: INFO networking_nsxv3.common.synchronization [req-8cf77145-1dee-4bb5-a479-197f748215d4 req-7bb4c585-53cf-44be-8311-ea2b7cde5eb0 tempest-AttachVolumeShelveTestJSON-1305349155 tempest-AttachVolumeShelveTestJSON-1305349155-project-member] Enqueued Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_members [ 1487.421617] env[65413]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8d5f46bc-a102-421f-b2b7-ad40844137df with Priority: HIGHEST for action security_group_members [ 1487.422265] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock member-8d5f46bc-a102-421f-b2b7-ad40844137df taken with stack trace [, , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.422265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.422265] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.422511] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.422585] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.422682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.422786] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.422913] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.422964] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.423628] env[65413]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8d5f46bc-a102-421f-b2b7-ad40844137df',) {} {{(pid=65413) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1487.926307] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.926588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.926588] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.926863] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.926992] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.927261] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.927397] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.927482] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.927669] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.927775] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.927867] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5f46bc-a102-421f-b2b7-ad40844137df is going to be updated. [ 1487.957930] env[65413]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=65413) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1487.958204] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1487.958256] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1487.958561] env[65413]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1487.958682] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1487.967896] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5f46bc-a102-421f-b2b7-ad40844137df in Status: IN_PROGRESS for 2s [ 1489.979309] env[65413]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8d5f46bc-a102-421f-b2b7-ad40844137df in Status: SUCCESS [ 1489.979768] env[65413]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8d5f46bc-a102-421f-b2b7-ad40844137df deletion is rescheduled due to dependency. [ 1489.979768] env[65413]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8d5f46bc-a102-421f-b2b7-ad40844137df" {{(pid=65413) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1492.422700] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1492.423156] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1497.423538] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1497.423538] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1502.424659] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1502.425087] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1507.426115] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1507.426466] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1512.427393] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1512.427871] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1517.428391] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1517.428835] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1522.429259] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1522.429704] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1527.430309] env[65413]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1527.430309] env[65413]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0